Difference between Arduino 5V power and output of 7805 5V power

I see no reason why that circuit shouldn't work.

I can only suggest going back and double checking your connections. I have attached a schematic to help.

Note that the + terminal of the supply goes to the Input pin of the 7805, and the - terminal goes to the GND pin.

7805-LED.png