Super easy, just took 10k titles/comments/points from the Angolia API, formatted them as JSON Lines like the following with jq, and fed them to the very well built and documented openai CLI.
{"prompt": "A plausible Hacker News title:", "completion": " The Feynman Lectures on Physics (1964) (280 points, 62 comments) END"}
The space at the beginning of the completion is for tokenizing, and the END token is for use as a stop token in the generations.
Comments
Interested in the process for fine tuning gpt3 for this
Super easy, just took 10k titles/comments/points from the Angolia API, formatted them as JSON Lines like the following with jq, and fed them to the very well built and documented openai CLI.
{"prompt": "A plausible Hacker News title:", "completion": " The Feynman Lectures on Physics (1964) (280 points, 62 comments) END"}
The space at the beginning of the completion is for tokenizing, and the END token is for use as a stop token in the generations.
Thanks!