Most 7805 regulators need like 10uF & 1uF caps, they are good for large current filtering.
In addition, you should have 100nF caps right at the VCC, AVCC, and Aref pins to filter out any high frequency noise on the power lines and to provide high-speed bursts of current to support the 16 MHz switching that goes on inside the chip.