Background audio stops working halfway through the night

Hi! I have the app set to background audio, my phone set to high volume and not silenced or in DnD mode. Before I go to sleep it works just fine with the sound coming through clear. But then I go to sleep and at some point in the night my partner wakes me up because the baby is screaming