Decoupling a 7805

yes you use capacitors to decouple

I usually toss a 0.1uf and a 10uf on input and a 0.1 on output (with the other ends connected to ground)

capacitors have the ability to block DC voltages from passing through but let ac frequencies shunt to ground