450 points by ai_chatbotguy 6 months ago flag hide 30 comments
shahar_a 6 months ago next
Fantastic article! I've been exploring TensorFlow for a while and been looking for ways to build a multilingual chatbot. This is just what I needed!
code_523 6 months ago next
@shahar_a: I'm curious, have you encountered any challenges while implementing the chatbot? Anything you think the successful candidates ought to sidestep? Thanks!
shahar_a 6 months ago next
I had some difficulties with languages that aren't as widespread, like Norwegian, Finnish and a few others, but there's always the option to train custom models for those cases. I think it's worth the struggle.
code_523 6 months ago next
That makes a lot of sense. Thanks for elaborating on it @shahar_a.
code_523 6 months ago next
@code_523: After diving into it some more, I agree! Thanks again for your input. @tf_expert: Great suggestion, thank you.
code_523 6 months ago next
@code_523: Seeing how well this thread has unfolded, I'm tempted to build my chatbot with TensorFlow as well, so thanks again for the insight. I think I'm closer to pressing 'Start' than I've ever been.
code_523 6 months ago prev next
@shahar_a Thank you for sharing. I'll look further into it when I implement my own bot. Do you think using pre-trained models and fine-tuning them to the specific language would yield reasonable results?
shahar_a 6 months ago next
I believe so, yes. Just confirm that the pre-trained models have sufficient data for your target language. You could try using the Hugging Face hub for a vast range of pre-trained models.
plus_one 6 months ago prev next
I've used SOFIA (an open-source, extensible NLP framework) to overcome issues with Norwegian and Afrikaans translations.
shahar_a 6 months ago next
SOFIA sounds intriguing! I'll be sure to give it a try. Thanks again!
ml_grad 6 months ago prev next
I'd love to see this project open-sourced after completion – I can envision several university projects leveraging this for their AI/ML courses!
ml_grad 6 months ago next
That would be an amazing project, I'm sure students will be able to learn a lot from it.
the_fourth_agent 6 months ago prev next
I've been using Transformers library in my personal projects recently. Looking forward to trying it out for a chatbot. Thanks for sharing!
the_fourth_agent 6 months ago next
Good idea @the_fourth_agent, I've been thinking about building a tutorial along the way as I start coding, so I'll plan to release it by the end of the month.
quantum_penguins 6 months ago next
Any existing integration for popular chatbot platforms like Dialogflow, Botpress, etc.?
shahar_a 6 months ago next
Unfortunately, no existing integration for popular chatbot platforms yet, but I imagine there'll be some eventually, so I recommend folks keep a lookout. #fingerscrossed
ml_meets_space 6 months ago prev next
Really cool idea! I've always struggled with language translation when building bots that should span multiple languages. I'm glad someone finally put together something like this.
ml_meets_space 6 months ago next
I can't wait to see that, I'll be following along. Good luck with your project!
the_fourth_agent 6 months ago prev next
[https://github.com/huggingface/transformers Transformers library on GitHub]
the_fourth_agent 6 months ago next
Thank you, I've found pre-trained models on Hugging Face before
the_fourth_agent 6 months ago next
Likewise. I'm truly fascinated by the support you've received for your project.
mlbot99 6 months ago prev next
Hugging Face is awesome! Great to see it catching on.
bot_builder 6 months ago next
Hugging Face complements TensorFlow quite well. More options for Transformers is always a good thing.
tf_expert 6 months ago prev next
If you're using TensorFlow, I'd suggest checking out their official docs on stateful dynamic RNNs: [https://www.tensorflow.org/api_docs/python/tf/keras/StatefulDynamicRNN]
bot_builder 6 months ago next
For anybody interested in stateful dynamic RNNs for TensorFlow, I published a short article here: [https://bot-builder-tips.com/stateful-dynamic-rnn]
utahdata 6 months ago next
I'll definitely give that article a read, thank you @bot_builder.
tf_queen 6 months ago prev next
Are there any resources/guides the author could recommend for people who may be new to the TensorFlow library? I'd love to get the hang of it before diving in.
tf_random 6 months ago next
There's a course on tensorflow.org called 'TensorFlow in Practice' that I believe provides a good overview of the TF ecosystem. It also has some tricks and tips, so it could help get your feet wet.
ml_304 6 months ago prev next
Is there an expected release date or beta for your project, @shahar_a?
shahar_a 6 months ago next
I'm planning on a beta release in a couple of weeks! Reach out if you have any questions. I'm glad I could help inspire you @code_523!