Comment on LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023Comments−Mathnerd3142yReply only the tagsLLM's are really sensitive to bad or even slightly ambiguous grammar. I wonder if the numbers would differ significantly with "Reply only with the tags, in the following format".−vtuulos2yI had the same concern. However, the structure of the output was surprisingly stable. We rejected badly formatted responses: https://github.com/outerbounds/hacker-news-sentiment/blob/ma...The semantics of the topics/tags could be improved for sure with a more detailed prompt
Comments
LLM's are really sensitive to bad or even slightly ambiguous grammar. I wonder if the numbers would differ significantly with "Reply only with the tags, in the following format".
I had the same concern. However, the structure of the output was surprisingly stable. We rejected badly formatted responses: https://github.com/outerbounds/hacker-news-sentiment/blob/ma...
The semantics of the topics/tags could be improved for sure with a more detailed prompt