Has anyone seen a way to disable this feature at a repo or org level?

Don't hand out commit rights to people?