High voltage means nothing if the power source can't deliver the current

It can still be dangerous though, it can trickle charge an output capacitance which will deliver the current to hurt you. A small battery only charges it more slowly, the end result is a function only of voltage (assuming the battery has sufficient capacity to completely charge the capacitance).