224 points by deeplearner 6 months ago flag hide 31 comments
user1 6 months ago next
Just started working on a Chatbot using Neural Networks and Deep Learning from scratch! Super excited! Any tips from the community?
deeplearning_expert 6 months ago next
Great job! I would recommend starting with Keras or TensorFlow to build the NN. And, make sure to properly preprocess the data before training.
user1 6 months ago next
Thanks! Currently checking out TensorFlow but would you have any resources to recommend on data preprocessing?
deeplearning_expert 6 months ago next
Here are some resources that will help: 1. Data Preprocessing for Deep Learning, available on Coursera 2. TensorFlow tutorial on Dialogflow (formerly API.ai) 3. This book: Deep Learning for Natural Language Processing: A Case Study Approach with TensorFlow
user3 6 months ago next
I would second the recommendation for Data Preprocessing for Deep Learning on Coursera. The instructor, Andrew Ng, is great and the content is easily understandable. Will also be looking forward to the updates from @user1!
user4 6 months ago next
Just came across a GitHub repo for a Chatbot built with Deep Learning. Here's the link: [link]. Might be useful to check it out!
user1 6 months ago next
Great, thank you! Adding it to my list of resources.
user4 6 months ago prev next
If you’re looking for pre-trained models for your chatbot, look no further than the Hugging Face transformers library. The library includes pre-trained models for a variety of NLP tasks, including question-answering and chatbot-building. The library also provides functionality for fine-tuning these models on your custom dataset. Here’s the link: [link](link)
user1 6 months ago next
This is so helpful! Thank you so much @user4 for providing such a great recommendation! Bookmarked for sure.
user5 6 months ago prev next
Just wanted to chime in and say that I've used Dialogflow for building chatbots and it has been a smooth experience. The integration with TensorFlow is seamless and provides a good starting point for beginners.
user6 6 months ago next
The Dialogflow team also frequently organizes events and webinars to help beginners with their chatbot journey. Highly recommend joining their community for staying up-to-date with building chatbots using TensorFlow and DL.
user5 6 months ago prev next
I completely agree with the recommendation of using LSTM layers in Keras with TensorFlow as the backend for building chatbots. It provides a more advanced understanding of context and allows for a more dynamic conversation experience with fewer hard-coded rules.
user1 6 months ago next
Interesting, this is new to me. Will try it out. Thanks for sharing @user5.
user9 6 months ago prev next
I just started exploring the Hugging Face transformers library and it has provided me with great pre-trained models and ease of fine-tuning for chatbot-building. Highly recommended! @user1, check it out!
user1 6 months ago next
@user9 Thanks for the recommendation! Will add it to my list of resources. Good to know that someone else also benefited from it.
user6 6 months ago prev next
It’s great to hear that you’re open to suggestions! I also have a few recommendations for building the chatbot. I’ve used specific tools like ChatterBot, NLTK and Prodigy in some of my projects. These tools are totally worth exploring! Maybe you should give these a try!
user1 6 months ago next
That sounds great! I've heard of those tools before but haven't explored them yet. Will make sure to check them out. Thanks a ton @user6!
deeplearning_expert 6 months ago prev next
Another thing you might want to look into is to incorporate Attention Mechanisms into your model. It will allow your chatbot to attend to specific parts of a conversation to handle them effectively. Here’s a paper you might find useful: [link](link)
user1 6 months ago next
@deeplearning_expert, thanks for the insightful suggestions. I was thinking of adding an attention mechanism to handle specific parts of conversations effectively. Will try this out for sure.
deeplearning_expert 6 months ago prev next
Another thing that I forgot to mention earlier is to use LSTM (Long Short Term Memory) based recurrent neural networks for handling the context in conversations. This will make your chatbot more intelligent in handling and understanding user requests.
user1 6 months ago next
@deeplearning_expert, thanks for this tip. Adding LSTM to the DL model now.
machine_learning_fan 6 months ago prev next
I also built a chatbot a few months ago. Check out this tutorial I followed: [link](link). Had a great learning experience!
user2 6 months ago prev next
Good luck, I've tried building a chatbot before and it was a fun journey! Keep us updated with your progress.
user1 6 months ago next
Thanks! I'll share updates on this thread.
user2 6 months ago prev next
Also, @user1, it would be great if you could share your code and process in a blog post once your chatbot is ready. Would be happy to read and give feedback!
user1 6 months ago next
Definitely, a blog post is on the cards. And would love to get feedback from the community.
user2 6 months ago prev next
And, if you use GitHub, I would be happy to make some valuable contributions to the code base of the chatbot. Just hit me up when @user1 publishes the repo!
user7 6 months ago prev next
Would highly recommend looking into this talk from last year's TensorFlow Dev Summit: [link](link). It has a detailed tutorial on creating a Chatbot with TensorFlow. Good luck @user1!
user8 6 months ago next
Thanks for the link! @user1, are you planning to share any code online?
user1 6 months ago next
I'm planning to share all the code in a GitHub repo. I'll link it to a medium blog post once the chatbot is ready so people can easily access it. Will update this thread when that happens.
user8 6 months ago next
Sweet! Looking forward to checking out the blog post :) Keep us posted.