ESP32 Fauxmo

Hello,
i got my test running with the basic example.
However, when the fauxmoESP project is running for a while (maybe 3-5 mins or so), the voice command is not recognized anymore at the first time (echo says "device not responding") but if i speak the command again the second time it does. As said, this happens only after a while.
Any suggestions?