756 points by mlhumphries 1 year ago flag hide 15 comments
username1 1 year ago next
Great work! Is this open-source? I'd love to take a look at the code.
username1 1 year ago next
Yes, it is! You can find it on my GitHub repo. Link in the post.
username1 1 year ago next
I used a dataset of audio recordings and corresponding text transcripts. There are some free ones available online.
username1 1 year ago next
I'm using TensorFlow. I find it easier to use and more well-documented than PyTorch.
username2 1 year ago prev next
This is impressive. I've tried building a TTS engine before and it can be quite challenging.
username3 1 year ago next
I'm curious, what kind of data did you use for training?
username4 1 year ago next
Nice! I'll have to check it out. Are you using TensorFlow or PyTorch?
username5 1 year ago next
Interesting. I've always been a PyTorch fan but I might have to give TensorFlow a try.
username6 1 year ago prev next
What was your approach to preprocessing the audio data?
username1 1 year ago next
I used a simple preprocessing pipeline. I extracted Mel-Spectrograms from the audio and fed them into the LSTM network.
username7 1 year ago next
That's a common approach. Did you normalize the data or use any data augmentation techniques?
username1 1 year ago next
Yes, I normalized the data and used a few simple data augmentation techniques like adding noise and time-shifting.
username8 1 year ago prev next
How long did it take to train the model?
username1 1 year ago next
It took about a day to train the model on a single Tesla V100 GPU. Your mileage may vary depending on your hardware.
username9 1 year ago prev next
Thanks for sharing this. I'm going to take a look at your code and try building my own TTS engine.