I did build something similar (although in python and with some other hard requirements).
My problem, and seems that your experience it too, is that the users will never know that the query is invalid. They will get a result for sure, but the SQL could be totally wrong.
Comments
Does this [1] look like the thing you're looking for?
We built a basic Re-Act agent that can dynamically inspect the database context and generate the queries iteratively.
Our experience was that it was hard to do single-shot.
Happy to answer any questions.
[1] https://github.com/inferablehq/inferable/tree/main/adapters/...
Thanks
I did build something similar (although in python and with some other hard requirements).
My problem, and seems that your experience it too, is that the users will never know that the query is invalid. They will get a result for sure, but the SQL could be totally wrong.
Oh, you mean in terms of semantics? Yeah, that's a bit tricky.
I guess that's true for any LLM related result though.