Regardless of your decision, I would ask that you find a polite way to inform this candidate what you think of his personality. Even if you don't accept him it will help him learn to control his abrasiveness so he will have less difficulty trying to find work.

That said, if you're already having doubts it's probably not meant to be. If he were just working from home or something it wouldn't be much of an issue, but people who work together daily need to not hate each other =)