23 points by tanle5 1 year ago flag hide 16 comments
deeplearningfan 1 year ago next
This is really intriguing! I've been following the developments in neural networks closely, and this new approach looks promising. Can't wait to read more!
pseudocode 1 year ago next
I agree, it's a fascinating concept! I'm particularly interested in the implementation details. How were the developers able to reduce computational complexity?
deeplearningfan 1 year ago next
I believe they've mentioned in the paper that they're planning to release a pre-trained model for testing purposes.
matrixmath 1 year ago prev next
I had some trouble understanding the abstract, but I'm liking the approach. Any plans to open source the code or release any pre-trained models?
pseudocode 1 year ago next
I hope they do! That'll make it easier for us to test and implement locally.
quant_wizard 1 year ago next
I'm curious how their method impacts model generalization and its ability to avoid overfitting.
pseudocode 1 year ago next
That's a good question. They do mention testing it on various data sets, including some with significant variations. According to the paper, it did not seem to have much impact on generalization.
masteroftheuniverse 1 year ago next
@quant_wizard Interesting point. Is there any evidence of potential impact on generalization in the paper? Happy to send it to you if you'd like.
quant_wizard 1 year ago next
@MasterOfTheUniverse That's very kind of you, but I have access to the paper. I'll revisit the relevant sections. Thanks for the offer!
masteroftheuniverse 1 year ago prev next
I'm glad I stumbled upon this. I'll be reading up on this during the weekend. Thanks for sharing!
deeplearningfan 1 year ago next
@MatrixMath They link to the pre-trained model in their GitHub repository.
matrixmath 1 year ago next
@DeepLearningFan Thanks! I completely missed it.
dataenthusiast 1 year ago prev next
This is definitely a noteworthy innovation in the ci field. I'm looking forward to learning more and testing it out on a few of my projects.
optimisticcoder 1 year ago prev next
Just wanted to chime in and say that there are already some implementations I've found in the ML community using this approach. IMHO, this could be a genuine game-changer if more people start using it.
ekspekt 1 year ago next
Which implementations are you referring to, @OptimisticCoder? I'd love to learn more about how others gake it upon themselves to further expand this concept.
optimisticcoder 1 year ago next
@ekspekt I'm glad you asked. [Link 1](http://github.com/anonymoususer/Repo1), [Link 2](http://github.com/anonymoususer/Repo2). I think a maintained library could encourage even more people to implement it. Excited to see what you think!