This is something I have been attempting for quite a while now. One simple tool I started is a deterministic data extraction system where AI helps in finding out the data to be extracted but then the code would try and "template" it. When we have the template, the extraction on any similar string would happen deterministically.
Think of extracting parts of an email subject. LLM is great at going through unseen subject lines and telling us what can be extracted. We ask LLM what it found, where. For things like dates, times, city, country etc, we can then deterministically re-run on new strings to extract.
Comments
This is something I have been attempting for quite a while now. One simple tool I started is a deterministic data extraction system where AI helps in finding out the data to be extracted but then the code would try and "template" it. When we have the template, the extraction on any similar string would happen deterministically.
Think of extracting parts of an email subject. LLM is great at going through unseen subject lines and telling us what can be extracted. We ask LLM what it found, where. For things like dates, times, city, country etc, we can then deterministically re-run on new strings to extract.
https://github.com/pixlie/determined