801 points by code_wizard 7 months ago flag hide 18 comments
john_doe 7 months ago next
Great work! I've been looking for a distributed file system written in Rust. Have you considered adding support for Redundancy and Fault Tolerance in the future?
author 7 months ago next
Yes, those features are on the roadmap! Stay tuned. /u/john_doe
another_user 7 months ago prev next
I noticed that you're using libp2p as a library. How well has it been performing? Are there any limitations or challenges regarding performance that you have run into?
author 7 months ago next
libp2p has been performing reasonably well. There are a few challenges regarding peer management and ensuring that metadata is always propagated through the network, but we are constantly optimizing. /u/another_user
third_account 7 months ago prev next
This work is really impressive! I am curious about the testing framework you are using, especially for testing the distributed nature of the application. Would you mind sharing some insights? /u/author
author 7 months ago next
Thank you! We are using a combination of property-based testing with some carefully crafted integration tests to ensure the robustness of the application. Another user even wrote some very inspiring posts on HN about this topic, which we found valuable as well. /u/third_account
tester 7 months ago prev next
Could you share some of the performance metrics? We are very interested to know network throughput and latency figures so we can analyze if it would be a good fit for our project requirements. /u/author
author 7 months ago next
Certainly! We have consistently seen latencies of around 10ms for most file transfers and are clocking an average of 200MB/s throughput. We're confident in scaling up the system as well. /u/tester
superhacker 7 months ago prev next
Awesome contributions! Any chance we can have a look at the version control history, maybe on GitHub, to appreciate the milestones in the project?
author 7 months ago next
Of course, here's the link to our repository: https://github.com/my-dist-filesystem/repo. Do have a look, and feel free to create an issue or send a pull request if you find something interesting. /u/superhacker
bigthinker 7 months ago prev next
It's on my list of projects to study. I'll probably spend this weekend setting it up and running some tests on it. I'll report back on Monday if that's alright with you?
author 7 months ago next
That would be fantastic! I truly appreciate your interest. Keep us posted about your findings. /u/bigthinker
socrates 7 months ago prev next
I'm curious about why you chose Rust for this particular project as opposed to Go? I wonder if that impacts the performance or development compared to other languages. /u/author
author 7 months ago next
We found that Rust offered better compile-time checks, pattern matching capabilities and strong memory safety guarantees. While Go has a larger ecosystem and better tooling, we found Rust more suitable for this type of work due to its unique features. /u/socrates
geek 7 months ago prev next
Have you published this on crates.io? I would like to include this in my other projects.
author 7 months ago next
We are still building out some features and stabilizing some interfaces, but I hope to publish it soon. Keep an eye out! /u/geek
onlooker 7 months ago prev next
What are the next big milestones on your project roadmap?
author 7 months ago next
We'll add the Redundancy and Fault Tolerance capabilities, continue optimizing for performance and develop a richer CLI for better user interaction. /u/onlooker