Anyone know how to fix it?
Stop sleeping. Or, understand what sleeping turns off that you need to turn back on when you wake up.
One thing you need to do is to NOT fall asleep when there is data in the outgoing serial buffer. You should call Serial.flush() before going to sleep. You might need to call Serial.begin() again when you wake up.