[Solved] Powering the Nano from a 5.1V power source

This:

When using the USB output it works. When I use one of the 5V outputs on the side to power the Nano using the 5V and GND pin, it does not, even though I can measure 5.1V on that output.

Edit: Powering it with any 5V source through the 5V and GND pins appears to have the same effect.