Should I leave

So me and my partner have been having some pretty intense rows. The last one being last night. My partner had our little one and I went downstairs to make a drink. He comes down and asks what I’m doing so I said I was making a hot drink. He’s then asked why didn’t I ask him to do it, I’ve replied with I wanted to do it myself. He’s then gone in a mood, and it turns out he’s nervous around me. I’m thinking ok why, and he’s said because I insinuated he was controlling me. I asked why he thought that and he said I’d said I wanted to make it myself is that ok? I didn’t say is that ok and told him this, I’ve said I wanted 5 mins to myself because it’s tough trying to get our baby to sleep when she won’t sleep. We’ve had a massive row to the point he’s brought up previous arguments, and even said to me when I was on the loo oh are you thinking of what you can make up now. I’ve hit the roof at this and he’s gone ok sorry for that comment but that’s all you’re getting from me. I’m not apologising for something that he’s made up about me, and tbf why is he even thinking I’m going to do this if he cares about me, and I’m the mother of his kids. I just don’t know what to do anymore I’m sick of walking on egg shells, thinking if I say something he’s going to kick off. He’s spent half the night downstairs (his choice). I just can’t cope with his insecurities anymore, he’s scared about the world and if you say the wrong thing you’ll be prosecuted I can’t live like this anymore. He even brought up his previous marriage and that was why he left, because of controlling behaviour. I’m starting to think this relationship is getting toxic now and is going to fail