Hugs. It's never an easy decision, but there's nothing lonelier than being with the wrong person imo.
He sounds a wee bit like my ex... things were going wrong, and I made it clear that I was getting to the stage where I would finish the relationship entirely if things didn't improve, and my ex just needled and pushed away at me until there ended up being a massive argument. Looking back, I think he knew that he didn't have it in him to make any compromises to save the relationship, and to that end, pushed me until I ended it. It sounds like your fella was a wee bit similar.
Onwards and upwards!!!