1. someone could make a shitload of money building a tool for learning how to prompt engineer LLMs in a formal course setting. Would be better than most of the GPT grifts currently circulating.
2. the ETHZ writer, while having a generally good grasp, seems to not understand the concept of Attention here. Or that you can do additional training on these models (even just RLHF). I don't think I understand RLHF, Attention, or extra training (new NN layers right?) enough to comment further.
There are already sites online that enable students to cheat. There are people that can churn out high quality essays for a very low price. Is there a place for lower quality essays at a lower price in that market?
Something like that. Since interacting with the model is the best way to learn how to use it, a good course could just put that experience on rails to direct the student's learning towards optimal ways to use the chat bot.
Comments
Two thoughts on this:
1. someone could make a shitload of money building a tool for learning how to prompt engineer LLMs in a formal course setting. Would be better than most of the GPT grifts currently circulating.
2. the ETHZ writer, while having a generally good grasp, seems to not understand the concept of Attention here. Or that you can do additional training on these models (even just RLHF). I don't think I understand RLHF, Attention, or extra training (new NN layers right?) enough to comment further.
There are already sites online that enable students to cheat. There are people that can churn out high quality essays for a very low price. Is there a place for lower quality essays at a lower price in that market?
Like A/B testing prompts and comparing output type of learning?
Something like that. Since interacting with the model is the best way to learn how to use it, a good course could just put that experience on rails to direct the student's learning towards optimal ways to use the chat bot.