You can't downvote direct replies to yourself.