It creates embeddings from the full text as well as its extracted structure, then semantically combines and compares it with action prototypes. A separate classifier estimates whether the turn is a command, question, chat, clarification or complex request. Everything gets merged together.

Does this mean the prototypes and classifications need to follow what you can actually do in the game? Were they all hand-coded or generated somehow?