801 points by code_wizard 1 year ago flag hide 18 comments
john_doe 1 year ago next
Great work! I've been looking for a distributed file system written in Rust. Have you considered adding support for Redundancy and Fault Tolerance in the future?
author 1 year ago next
Yes, those features are on the roadmap! Stay tuned. /u/john_doe
another_user 1 year ago prev next
I noticed that you're using libp2p as a library. How well has it been performing? Are there any limitations or challenges regarding performance that you have run into?
author 1 year ago next
libp2p has been performing reasonably well. There are a few challenges regarding peer management and ensuring that metadata is always propagated through the network, but we are constantly optimizing. /u/another_user
third_account 1 year ago prev next
This work is really impressive! I am curious about the testing framework you are using, especially for testing the distributed nature of the application. Would you mind sharing some insights? /u/author
author 1 year ago next
Thank you! We are using a combination of property-based testing with some carefully crafted integration tests to ensure the robustness of the application. Another user even wrote some very inspiring posts on HN about this topic, which we found valuable as well. /u/third_account
tester 1 year ago prev next
Could you share some of the performance metrics? We are very interested to know network throughput and latency figures so we can analyze if it would be a good fit for our project requirements. /u/author
author 1 year ago next
Certainly! We have consistently seen latencies of around 10ms for most file transfers and are clocking an average of 200MB/s throughput. We're confident in scaling up the system as well. /u/tester
superhacker 1 year ago prev next
Awesome contributions! Any chance we can have a look at the version control history, maybe on GitHub, to appreciate the milestones in the project?
author 1 year ago next
Of course, here's the link to our repository: https://github.com/my-dist-filesystem/repo. Do have a look, and feel free to create an issue or send a pull request if you find something interesting. /u/superhacker
bigthinker 1 year ago prev next
It's on my list of projects to study. I'll probably spend this weekend setting it up and running some tests on it. I'll report back on Monday if that's alright with you?
author 1 year ago next
That would be fantastic! I truly appreciate your interest. Keep us posted about your findings. /u/bigthinker
socrates 1 year ago prev next
I'm curious about why you chose Rust for this particular project as opposed to Go? I wonder if that impacts the performance or development compared to other languages. /u/author
author 1 year ago next
We found that Rust offered better compile-time checks, pattern matching capabilities and strong memory safety guarantees. While Go has a larger ecosystem and better tooling, we found Rust more suitable for this type of work due to its unique features. /u/socrates
geek 1 year ago prev next
Have you published this on crates.io? I would like to include this in my other projects.
author 1 year ago next
We are still building out some features and stabilizing some interfaces, but I hope to publish it soon. Keep an eye out! /u/geek
onlooker 1 year ago prev next
What are the next big milestones on your project roadmap?
author 1 year ago next
We'll add the Redundancy and Fault Tolerance capabilities, continue optimizing for performance and develop a richer CLI for better user interaction. /u/onlooker