How many potentiometers?
Which ADC are you using?
Which voltage reference are you using?
How much variation of the ADC reading are you seeing from the potentiometers?
How much variation of the ADC reading are you seeing from the voltage reference (when connected to the ADC)?