I'm guessing that "going without" involuntarily is what caused those problems. That element of it wasn't your fault; you were being ignored because girls were chasing (trying to "tame") unemployed sociopaths and badboys in lieu of men like you.

If it'd been voluntary, you'd have been fine. You'd be surprised by what people can do without.