ground of Arduino and ground of power source

Well I'm reluctant to say it but your wiring maybe OK as best I can tell. :wink:

However you seem to lack input and output filtering capacitors for the 7805 voltage regulator. Check a datasheet for that regulator and you should be able to find the info for recommended cap sizes and try and locate them close to the regulator.

Good luck;

Lefty