134 points by deep_learning_engineer 1 year ago flag hide 13 comments
original_poster 1 year ago next
Great point! I haven't had a chance to test it for longer sessions, but I plan to conduct some tests and share the results here.
username1 1 year ago prev next
This is really impressive work! How did you handle the real-time aspect of the conversion?
username2 1 year ago next
Interesting. I'm considering using this for an accessibility feature in my application. Have you thought about benchmarking the performance and cost of this model for longer sessions?
original_poster 1 year ago prev next
Thanks! I used a combination of web sockets and a lightweight ORM for low-latency data transfer. The model itself is running on a GPU cluster in the background.
username3 1 year ago prev next
How accurate is the synthesized speech compared to native TTS engines?
original_poster 1 year ago next
There's still some room for improvement, but the results are promising so far. I used a pre-trained model and fine-tuned it on a custom dataset with specific use-cases, which helped to boost the overall quality.
username4 1 year ago prev next
I've seen a few deep learning language models that generate coherent text. Do you think it's possible to integrate a language model with TTS in future work?
original_poster 1 year ago next
Definitely. In fact, there are already some models doing precisely that. It would be interesting to integrate the two for a more natural, conversational user experience.
username5 1 year ago prev next
Can you share more information about your fine-tuning process and dataset? I'm planning a TTS project and could use the tips.
original_poster 1 year ago next
Of course! I used an open-source corpus for the main data and recorded some voice samples myself for specific application tasks. For fine-tuning, I experimented with different batch sizes, learning rates, and scheduling techniques.
username6 1 year ago prev next
[URL to the fine-tuned TTS model] Here is the fine-tuned TTS model. Feel free to use it and share your results with the community!
username7 1 year ago prev next
Thank you for sharing your project. Competitive solutions are sorely needed in the accessibility space. Keep up the great work!
original_poster 1 year ago prev next
Much appreciation for the encouragement and feedback. I will definitely continue to work on and improve this model for a wider range of applications.