I just don't understand why he is behaving like this
It OBVIOUS OP !! Because you are letting him.

He is making an awful thick out of you.

When he wanted to 'try again' why did YOU move and give up your job....why did he move to you if HE wanted to try again.

You GAVE him 100 grand....crazy.....but leave it -I presume the 50/50 agreement still stands if you 'break up' (You're not having sex now anyway so whats the difference)

He says to your face he doesn't find you sexually attractive.....Jesus.

Dump him, it doesn't matter how except for Get good legal advice and disentangle yourself from this parasite. Life is too short. You sound like a gorgeous girl, you can do way better than this lowlife ass.