I would try 0.1uF ceramic caps from each pot wiper to ground to help bypass noise and crosstalk to ground. This effectively lowers the input impedance as well..
Also, a dummy read to set up the ADC may help. Do a read of the channel and discard it, then do another read for real.j