I don't trust my baby daddy anymore - should I?

I had wanted to marry my man for 8 years now. We have been together for 10. He just married me this august, a very small registration, because he lied to me for a woman at work after we had our baby. Before he would say marriage is a waste of money because 60% of them end in divorce which seemed true but also felt quite unromantic. I had always been happy for my man to have as many female friends as he wants. He has met ladies on their own and I've never really cared and always trusted him but this one at work was different. She would meet him nearly every weekend sometimes with more plans than he had with me. She played with his hair in front of me. She wore very low tops and short skirts around him and he would drive her around wearing that cos he wanted to make sure she gets home safe after nights out. They had some overnight stays without inviting me although there was one other person there. I was asked to make a BBQ for him and his friends and then he shows up late with her alone cos she wanted to go to a pub first. I was left waiting cos of her. I left and took a break after this as I stopped finding him attractive. Then he promised he would never talk to her in a non professional manner again and it would be strictly work related and he would stop meeting her outside of work. He just made his friendship a secret after this. I got pregnant and was caring for our baby when I found out he's still friends with her and worst of all He would call me a bitch on his work Microsoft teams chat thinking I'd never see. Now I have had enough he has married me and I feel like an idiot thinking this marriage would make a difference but I still feel disrespected and angrier than I've ever been. I've told him nothing he can do is going to be able to regain my trust and it would have to be pretty big...he's made an effort for 3 days and already tired saying I don't appreciate him. I just can't look at him the same anymore. Why didn't he bitch about me to a male friend or anyone else but her... I have been quite angry at him, swearing a lot, saying he's no good and feeling guilty about this... He's also never really stood up for me when his dad's been mean to me or shouted at me, saying he wasn't there so he doesn't know what happened despite me telling him. He never liked me earning money more than him when we first met and to this date he barely celebrates my success the way he gets excited about his video games. He tried to convert me to Islam when we met and his family wanted me to have an islamic marriage. He snapped out of needing me to be islamic and isn't religious himself anymore but I agreed to do the islamic marriage to make his family happy at the beginning of our relationship and always asked for an Indian one and never got this in return.