Atmega32U4 never wake up after SLEEP_MODE_PWR_DOWN.

I have a custom board with atmega32u4 that never wake up after SLEEP_MODE_PWR_DOWN, but only if the board isn't connected to USB. When is connected to USB the atmega32u4 wake up normally. What is happening?

What signals will wake the processor from power-down? What signal are you expecting?