Engorgement and leaking

Hello! Our first baby we weren’t able to breastfeed so this is the first time I’ve been able to experience it. Because we have 2 under 2 I pump to give our newborn bottles at night or when I’m in more of a rush to do our older daughters routine (dinner, bath, etc) I have been having great output (usually 2-4oz pumping per boob) but I am constantly leaking and uncomfortable at night when we’re not breastfeeding. I usually stay up to pump 1-2x between 11pm and 6am. Our newborn is 2 weeks today. I was wondering if this is normal at night or maybe I’m pumping too much? I want to keep my supply up but I feel as if the pumping is almost controlling me at this point hahah