Or with uBlock₀ filter:

    news.ycombinator.com##[title='downvote']

Then for showing the downvote button someone can temporarily disable cosmetic filters from the uBlock₀ popup.