The hope is that RL in simulation can fill the gap.

Also there’s imitating humans, via a suitable mapping from the human sensor, control and configuration space to the robot’s. Some groups have gathered video and other data from humans doing tasks, for example with a VR headset.