I bet that any breakdown of this sort:

- minority X

- minority Y

- minority Z

- the uncategorized ones

Is going to find weird behavior around the last group, regardless of whether it's skin color or some other feature that's chosen to generate the partition.

Something about remarkableness (being a minority and being in the ivy league are both remarkable traits) not being evenly distributed.