Apparently Johnson's dictionary calls from whence "a vicious mode of speech", but (see above) Johnson uses the expression himself. Ah well, a foolish consistency is the hobgoblin of little minds. Speaking of which, by the way,

Ralph Waldo Emerson: "Life lies behind us as the quarry from whence we get tiles and copestones for the masonry of today." :-)