It's not a matter if HE is worth it. HIS happiness is his own responsibility, not yours.

What about YOUR happiness. Thinking ONLY of yourself, ask yourself, are all the hoops and tricks you need to perform in order to be happy worth it?

Of course he may miss you, but that too, is not your responsibility. You need to care for yourself.

BTW. Men who are abusive, or not very nice, rarely MEAN to be hurtful. It is just a part of who they are.

It's your decision to make.