I think you've acquired a mistaken picture of Reader Mode. Reader Mode (like the Readable and Readability bookmarklets) presents an alternative rendering of the same set of files from which the standard view is rendered: it does not cause the server to serve an alternative set of files.

Reader Mode and the Readable and Readability bookmarklets fail often even on "text-centric" pages such as blog posts.