I remember Andrej mentioning in [1] that is a challenging part, what materials/lectures/papers have you found or what ideas on what to do about that so far for that?
You can create chat-like situations with appropriate prompts.
For example, if I enter the message "Wow this day was horrible" to the chat application, it could translate it into a prompt like "Amy: Wow this day was horrible\nMe: " and the language model could auto-complete the response of me - assuming the language model was trained on chat logs between my friend Amy and me.
But as sigmoid10 mentioned, the quality of the replies will not be remotely comparable to ChatGPT.
Comments
I remember Andrej mentioning in [1] that is a challenging part, what materials/lectures/papers have you found or what ideas on what to do about that so far for that?
[1] https://www.youtube.com/watch?v=kCc8FmEb1nY
You can create chat-like situations with appropriate prompts.
For example, if I enter the message "Wow this day was horrible" to the chat application, it could translate it into a prompt like "Amy: Wow this day was horrible\nMe: " and the language model could auto-complete the response of me - assuming the language model was trained on chat logs between my friend Amy and me.
But as sigmoid10 mentioned, the quality of the replies will not be remotely comparable to ChatGPT.