Comment on Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]parentComments−gdjdkslslp1yI haven’t watched this video yet, but do you plan to create any technical videos in the (1) series on RL in LLMs?−MasterScrat1yHis intro to RL (not for LLM) blog post is a great read FYIhttps://karpathy.github.io/2016/05/31/rl/−amelius1yThis would be very welcome as it brings us closer to understanding the secret sauce behind training a real, practical LLM.
Comments
I haven’t watched this video yet, but do you plan to create any technical videos in the (1) series on RL in LLMs?
His intro to RL (not for LLM) blog post is a great read FYI
https://karpathy.github.io/2016/05/31/rl/
This would be very welcome as it brings us closer to understanding the secret sauce behind training a real, practical LLM.