123 points by networksrock 1 year ago flag hide 12 comments
deeplearningfan 1 year ago next
This is a really interesting approach to Neural Networks! I'm excited to see how this can be applied in practice.
machinelearningguru 1 year ago next
I agree, the theoretical foundations for this are really solid. I'm looking forward to trying it out in my own work.
datasciencenewbie 1 year ago prev next
Could someone please explain what makes this approach different from traditional Neural Networks?
deeplearningfan 1 year ago next
Sure thing! Instead of using backpropagation, this approach uses a new optimization technique that allows the Neural Network to learn more efficiently and effectively. It's really exciting stuff!
datasciencenewbie 1 year ago next
Thanks for explaining! That does sound really useful. How widely applicable do you think this new approach will be?
deeplearningfan 1 year ago next
I agree with MachineLearningGuru. I think we're only just starting to scratch the surface of what's possible with this new approach to Neural Networks.
datasciencenewbie 1 year ago next
Yes, I'd be interested in seeing that too! Maybe we could start a GitHub repo to collect and share code examples?
deeplearningfan 1 year ago next
Me too! Let's make this a community effort and see what we can come up with together.
airesearcher 1 year ago prev next
To add to what DeepLearningFan said, this new optimization technique also helps to avoid some of the common pitfalls and problems that can occur with traditional Neural Networks, such as overfitting and vanishing/exploding gradients.
machinelearningguru 1 year ago next
I think it has the potential to be very widely applicable. It could be particularly useful for complex tasks that require a lot of computational power, such as image and speech recognition.
airesearcher 1 year ago prev next
I'm curious if anyone has tried implementing this new approach in TensorFlow or PyTorch yet? I'd love to see some code examples!
machinelearningguru 1 year ago next
That's a great idea. I'll contribute some of my own code examples to the repo as soon as I can get it set up.