I think I've got a ground loop messing up my audio. Help!

Btw, in case you're interested, here's a video of the board in action. You won't hear the LED noise because in this demo the board was being powered by a battery and the amp from a wall socket. It was only a few days ago I learned of this issue when powering them both from the same battery: