The LLMs seem to have their own idea of how they want to do something

exactly! what I'm experiencing is that prompt engineering has its limitations and comes with inconsistency issues...

by designing the tool from scratch tailored to LLMs, we can make the interface match what their "own idea of how to do" that particular task, which is more reliable and scalable