I suspect your chip is being backpowered by one of the connected devices, so when you power it down it's still running.
Opening serial monitor causes the DTR autoreset circuit to reset the microcontroller (assuming it's an AVR based board without native USB), so that guarantees you a reset condition.