Yes, that's what I am talking about. They are a very common component so if you have a local electronics shop you can probably pick them up there.
They are connected between the positive power line and ground, the polarity doesn't matter.
There is an article here that goes into the technical details: De-coupling
BTW, how long are the wires connecting your arduino board to each of the servos? and to the pots?