Find Jobs
Hire Freelancers

Research distributed file storage systems on linux on Azure

€30-250 EUR

Closed
Posted over 3 years ago

€30-250 EUR

Paid on delivery
I want to research a good option for (almost) infinitely scalable file storage system that is fast to use by many concurrent nodes. Nodes are running Ubuntu 20.04. File system needs to be highly fault tolerant and it should handle automatic backups by configuration. System needs to support basic POSIX file permissions. There are two options: 1. Use managed (remote) service such as Azure Files (SMB). Even within Azure network the latencies are too high for high performance applications. This option would need a local RAM cache, which I believe is supported already by cachefilesd. 2. Manage the cluster by yourself using open-souce software such as: - MooseFS (free version has a single point of failure) - BeeGFS - LizardFS - Ceph - Quobyte Requirements are: - POSIX file permissions - High availability - Fault tolerant - Built-in backups via fault tolerance or a tool to use - High amount of concurrent reads, almost none concurrent writes What I need to research the best option based on which is easier to setup/manager, performance and especially high availability and fault tolerance. Cluster should be able to handle random node crashes. I want benchmarks for each good option from you. I also want benchmarks against standard HDD and SDD to get a baseline.
Project ID: 28310720

About the project

3 proposals
Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
3 freelancers are bidding on average €200 EUR for this job
User Avatar
HI There, I am experienced in CEPH with Gcloud. I have deployed erpnext in gcloud with ceph. I can help you in your project. Thanks Ashish A.
€250 EUR in 7 days
4.6 (32 reviews)
5.2
5.2
User Avatar
Hi, I can help you with the required research and also help you install a NDFS. Able to start immediately contact through chat.
€150 EUR in 1 day
5.0 (19 reviews)
4.2
4.2
User Avatar
Hi, I've read your requirements and I have proficiency in building Ceph cluster on RBD, CephFS and Ceph RGW use case. From your case, I think you need CephFS and I can help you set it up. Hit me up on PM and let's discuss. Regards.
€200 EUR in 7 days
5.0 (8 reviews)
2.9
2.9

About the client

Flag of FINLAND
Kajaani, Finland
0.0
0
Payment method verified
Member since Mar 16, 2020

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.