decoupling capacitor between +5 and gnd?
Yes and you need a big one. I would start off with a value of 220uF and go up it that is not a cure.
You can also use a series inductor for the amplifier supply like the last circuit on this page:-
http://www.thebox.myzen.co.uk/Tutorial/De-coupling.html