running every query I do through all of the SOTA models so I can directly compare the results

For everyday non-dev users, Msty for MacOS lets you run split chats and compare each model's answers.

https://msty.app