It's a small-ish "bug" in HN, IMO: there are times when you think something is wrong, and want to downvote it, but ideally would put it at 0, and no lower, because you can tell that it's probably an honest mistake, rather than an attempt to deceive or spread false information.

So people probably think you're wrong.