Is there like a high council of crypto wizards that keep checks and balances on each other?

Not exactly, but certainly there are some crypto wizards that would love to get famous for figuring out how to break the so-called trusted algorithms and libraries.