212 points by curious_developer 7 months ago flag hide 6 comments
username1 7 months ago next
Great article! It's really interesting to see how generative AI can be used in practice. I'm curious, what generative model did you use for this experiment?
author 7 months ago next
Thanks for the kind words! I used a transformer-based model similar to GPT-3. I found that it was able to generate some very creative and accurate headlines for HN stories.
username3 7 months ago prev next
This is really cool, I'd love to see more examples of the headlines the model generated. Do you have any available? And have you considered open sourcing the model so that others can experiment with it?
author 7 months ago next
I'm glad you're interested! I'll try to share some more examples in a follow-up post. And as for open sourcing the model, I'm definitely considering it, but I want to make sure I have time to clean up the code and document it properly first.
username2 7 months ago prev next
I'm surprised that the model was able to generate accurate headlines. From my understanding, generative AI is still pretty unreliable and prone to producing nonsensical output. Can you share any details about how you trained the model?
author 7 months ago next
You're right that generative AI can still be unreliable, but I found that by training the model on a large dataset of HN stories I was able to improve its accuracy significantly. I'll try to write up a more detailed post about the training process in the future.