I think you have to differentiate. At least in germany, most rail is not fenced off and when we do, we do not use fences but instead sound barriers. I think faster rail is usually behind sound barriers in populated ares, and slower commuter rail is often not fenced off. We do not have many at-grade crossings in more populated areas though, they are really only present on the country-side so I think the rail-infrastructure is not that "present". Nobody really walks or drives over rails usually and it's usually naturally separated, so you can't enter tracks by accident and therefore accidents are quite rare.