Part of my role is designing assessments for online courses and technical certifications. This is exactly what we want to build in our assessment development process. We want the LLM to monitor the training content and create draft questions and exercises that are vetted by humans. It's maybe a classic "human in the middle" design for content development, but the more we can put humans in at the right point and time and use LLMs for the other parts helps us create a more robust and up to date training and assessment system.
Comments
Part of my role is designing assessments for online courses and technical certifications. This is exactly what we want to build in our assessment development process. We want the LLM to monitor the training content and create draft questions and exercises that are vetted by humans. It's maybe a classic "human in the middle" design for content development, but the more we can put humans in at the right point and time and use LLMs for the other parts helps us create a more robust and up to date training and assessment system.