This is because everyone at the border moves away - both the majority and the minority. When the majority at the border moves away, that exposes more border to move into.

Bias near 2/3rds segregates hard, since even in the presence of interlopers, the border gets defended.