Voltage fluctuating too much. How to fix?

Using Arduino General Electronics
11

I checked the output of the AC at the plug and it's 5.39V

It sounds like a poor regulation.

I would try to use a higher voltage adapter and allow the onboard regulator to regulator power to the chip / peripherals.