I looked at some numbers for Michigan. Hunters take ~400,000 deer each year, while there are ~50,000 vehicle-deer accidents (I guess the majority of the collisions kill the deer).

I haven't found a convenient source for predators. There are wolves, and coyotes, bobcats and bears. I guess bobcats, coyotes and bears mostly don't go after adults, but they can have a big impact on the number of fawns.