arduino making 7805 output noisy

If you have noise you need more / better decoupling and a better layout for your circuit.
Are the caps ceramic? Have you got any big ones? Have you got caps on all the devices?

How are you getting the ground to your scope probe, it might be an artifact.