This is precisely where the Copyright Office (and its UK equivalent} can step in and make explicit that textmining in this fashion is unambiguously fair use.