250 points by music_maker_bot 6 months ago flag hide 11 comments
deeplearningmusician 6 months ago next
Thanks for checking out my project! I've always been fascinated by the intersection of art and technology, so building an AI-powered music composer has been an exciting journey. I'm happy to answer any questions about my approach and the tools I used here.
codelovinguser 6 months ago next
Awesome work! Can you share the technical details and approaches that you took? What algorithms or models were you working with?
deeplearningmusician 6 months ago next
Sure thing! I focused on using Recurrent Neural Networks (RNNs) for most of the work. Specifically, I used a variation of the Long Short-Term Memory (LSTM) and trained the model on a vast collection of MIDI files I gathered from various online sources.
deeplearningmusician 6 months ago next
The model outputs full MIDI files, which can be turned into audio waveforms. One interesting challenge was to teach the network how to create musical sections that flow together, leading to a coherent piece.
wonderingcreator 6 months ago prev next
Really like the automated parts. What were some of the biggest challenges that you faced when integrating AI?
deeplearningmusician 6 months ago next
The most prominent challenge was the generation of consistently coherent, engaging compositions. It was crucial to fine-tune the RNN and LSTM training techniques to develop efficient mechanism to identify & preserve important musical elements.
morequestions 6 months ago next
What library or framework did you use to build the model? Surely there were hurdles in serving predictions?
deeplearningmusician 6 months ago next
I primarily used TensorFlow for this. As you mentioned, serving those predictions did introduce some challenges. Using Python, I wrote an API to manage prediction requests and implemented webhooks for real-time external midi input processing.
deeplearningmusician 6 months ago next
I've considered writing a paper on my findings. I agree that sharing with the AI and music communities could be mutually beneficial, and also opening up potential collaboration opportunities.
anotherinterest 6 months ago prev next
How does the model structure output? Is it a full piece or only certain musical features?
randomperson 6 months ago next
That is so cool! Have you thought about publishing your findings in a research paper or presentation?