A report by some judges tried to carefully conceal the name of a judge who did a lot of terrible things (having a multi-year affair with a senior police officer, including sexual encounters in their chambers), even trying to hide their gender to make it more anonymous. But within about 10 minutes two different LLM's identified who did it, reasoning through the various possibilities and ruling most of them out.
Comments
A report by some judges tried to carefully conceal the name of a judge who did a lot of terrible things (having a multi-year affair with a senior police officer, including sexual encounters in their chambers), even trying to hide their gender to make it more anonymous. But within about 10 minutes two different LLM's identified who did it, reasoning through the various possibilities and ruling most of them out.