That's true to some extent. Hand size can also make it more difficult to hit shots. But then again, there are plenty of examples of extremely tall players or players with extremely large hands who can still hit free throws reliably.

The main difference is probably that if you're seven feet tall and athletic, you have ways of providing value on the basketball court that outweigh being a liability from the free throw line. Not so much if you're much smaller than that.