TTC second baby

We have started to 'try' have 2nd baby naturally after our daughter was IVF. Only on month 3 in but feeling like the stress of TTC is starting alot earlier this time. Low motility is why we need IVF 1st time. We have one frozen embryo but hubby wants to try naturally 1st. Feel like im just opeing myself up for all the horrible feelings again 😔 but really want my daughter to have a sibling. Xxx