50% means that they are indistinguishable. Deviation from 50% means that the channel has information about whether the subject is human or LLM. 0% is a perfect correlation (humans always correctly identify humans). 100% is a perfect inverse correlation (humans always think the machine is a human)
You can identify LLMs by asking the human to pick the most human participant. Then you invert their answer. The real human is the least human like participant.
Comments
Yes.
50% means that they are indistinguishable. Deviation from 50% means that the channel has information about whether the subject is human or LLM. 0% is a perfect correlation (humans always correctly identify humans). 100% is a perfect inverse correlation (humans always think the machine is a human)
You can identify LLMs by asking the human to pick the most human participant. Then you invert their answer. The real human is the least human like participant.