The quality of the pots or wiring is not an issue, there will always be some noise, and always some sampling jitter in the ADC. You need to introduce filtering in to the system. Either in hardware by adding a RC filter, or in software for example a dead band.