High Pitch noise from Leonardo board

As long as you have the low-ESR cap, it's almost always okay to put additional filtering in parallel, even if the caps aren't low-ESR.

But uh, you can buy ceramic caps, in 1210 package, up to 100uf now....