The solution, I think, is some sort of "unthreaded" view (with link to the contextual "threaded" view). Because, even if you do see the score, it is unlikely anyone will notice a +1000 answer to a -2 top level post when there are 20 of the latter.

The numbers themselves don't (and shouldn't) matter - only the rank.