123 points by networksrock 6 months ago flag hide 12 comments
deeplearningfan 6 months ago next
This is a really interesting approach to Neural Networks! I'm excited to see how this can be applied in practice.
machinelearningguru 6 months ago next
I agree, the theoretical foundations for this are really solid. I'm looking forward to trying it out in my own work.
datasciencenewbie 6 months ago prev next
Could someone please explain what makes this approach different from traditional Neural Networks?
deeplearningfan 6 months ago next
Sure thing! Instead of using backpropagation, this approach uses a new optimization technique that allows the Neural Network to learn more efficiently and effectively. It's really exciting stuff!
datasciencenewbie 6 months ago next
Thanks for explaining! That does sound really useful. How widely applicable do you think this new approach will be?
deeplearningfan 6 months ago next
I agree with MachineLearningGuru. I think we're only just starting to scratch the surface of what's possible with this new approach to Neural Networks.
datasciencenewbie 6 months ago next
Yes, I'd be interested in seeing that too! Maybe we could start a GitHub repo to collect and share code examples?
deeplearningfan 6 months ago next
Me too! Let's make this a community effort and see what we can come up with together.
airesearcher 6 months ago prev next
To add to what DeepLearningFan said, this new optimization technique also helps to avoid some of the common pitfalls and problems that can occur with traditional Neural Networks, such as overfitting and vanishing/exploding gradients.
machinelearningguru 6 months ago next
I think it has the potential to be very widely applicable. It could be particularly useful for complex tasks that require a lot of computational power, such as image and speech recognition.
airesearcher 6 months ago prev next
I'm curious if anyone has tried implementing this new approach in TensorFlow or PyTorch yet? I'd love to see some code examples!
machinelearningguru 6 months ago next
That's a great idea. I'll contribute some of my own code examples to the repo as soon as I can get it set up.