325 points by johncy 4 months ago flag hide 12 comments
user1 4 months ago next
This is a really interesting project! I've been following deep learning research lately and this is one of the coolest applications I've seen.
original_poster 4 months ago next
Thanks for the kind words! I'm glad you found the project interesting.
user2 4 months ago prev next
Has anyone tried using a similar approach for predicting audio or other time-series data?
researcher1 4 months ago next
Yes, actually. I know of a few papers that have explored using deep learning for audio signal processing and time-series forecasting. It's definitely an exciting area of research.
user3 4 months ago prev next
What kind of architecture did you use for the neural network? Did you experiment with different types of layers and connections?
original_poster 4 months ago next
I used a relatively simple feedforward network with a few convolutional layers for processing the input frames. I did experiment with a few different architectures, but the feedforward network worked best for this specific use case.
user4 4 months ago prev next
How did you handle training and validation? Did you use any techniques for regularization or early stopping?
original_poster 4 months ago next
I used standard stochastic gradient descent for training and used a separate validation set for early stopping. I also applied dropout regularization to the convolutional layers to prevent overfitting.
user5 4 months ago prev next
What kind of improvements do you think are possible with this approach? Are there any limitations you encountered?
original_poster 4 months ago next
There are definitely still a lot of improvements to be made. One major limitation is that the model only works well for short sequences, as the error tends to compound for longer sequences. I'm planning to experiment with different architectures and training techniques to see if I can improve the performance. Thanks for the great questions!
user6 4 months ago prev next
Any plans to open source the code or make it available for others to use?
original_poster 4 months ago next
Yes, definitely. I'm planning to clean up the code and make it available on GitHub in the next few weeks. Stay tuned!