250 points by rust_compilers 1 year ago flag hide 20 comments
rustcompilers 1 year ago next
Excited to announce our new Rust compiler that generates code in parallel, significantly reducing compilation time!
johnny24 1 year ago next
That sounds really promising. I was wondering if this technique would be useful for embedded systems or just high-level applications?
optimizetech 1 year ago prev next
I think this approach could be helpful for embedded systems, as it reduces the overhead of build times. Hoping to test it soon!
fardinki 1 year ago prev next
Does this imply any risk in terms of code compatibility, or optimizations made with single-threaded compilers?
timestorm 1 year ago next
It does not mean increased risk in terms of code compatibility. We've made sure to maintain consistency with the official Rust compiler.
rustcompilers 1 year ago next
That's correct. Parallel code generation does not affect the final code or single-threaded compiler optimizations.
sultan2k 1 year ago prev next
Any performance improvement estimates compared to the standard Rust compiler?
rustgenerated 1 year ago next
We've seen a speed-up ranging from 2x to 3.5x in initial testing. Best results were from small to medium-sized codebases.
cryptomeme 1 year ago prev next
What tools or libraries did you use to implement the parallelized aspect?
concurrencycake 1 year ago next
Our compiler heavily relies on OpenMP to manage multi-threaded code generation tasks. We automatically parallelize when possible.
moonsong 1 year ago prev next
How do you manage race conditions while generating the code?
racefree 1 year ago next
We rely on modern Rust's excellent memory safety and lock-free algorithms to minimize race conditions. Careful testing is required.
rustcleaner 1 year ago prev next
Can you discuss how the tool handles potential increases in memory footprints due to parallel processing?
rustutil 1 year ago next
We're actively working on reducing the memory footprint via smart buffering and caching techniques. However, more testing is needed.
metalbeliever 1 year ago prev next
How difficult was the integration with the LLVM project for code generation?
llvmfan 1 year ago next
agnegotiated extensions with the LLVM team to make the integration smooth. Modification of a few internal components was involved.
scientechk 1 year ago prev next
Here's a question for @rustcompilers: any plans to upstream this as part of the official Rust compiler - cargo?
rustcompilers 1 year ago next
Yes, our hope is to present these findings to the Rust community and work with the official compiler team to move forward!
tokiofan 1 year ago prev next
super excited about this, I would be thrilled to help test this new compiler on my open-source async project
idlellama 1 year ago prev next
Haven't tested yet, but curious what would happen if a dependency's crate still uses a standard Rust compiler. Has anyone experienced build issues with mixed dependencies?