Perhaps you haven't used LLMs enough, this style is extremely common with Claude. And can you link me a Pangram 4 example where it has lots of false positives? The main reason why Pangram is supposed to be reliable in the first place is that they trade false positives for false negatives.
Comments
What about your examples has an llm tell?
I don't trust pangram 4 much. There was a post here earlier confirming it fails for many others.
Perhaps you haven't used LLMs enough, this style is extremely common with Claude. And can you link me a Pangram 4 example where it has lots of false positives? The main reason why Pangram is supposed to be reliable in the first place is that they trade false positives for false negatives.