Floppy servo controller with pot control

Have you thought about using a rotary encoder? It would can be setup to work similar to how you want to use a potentiometer, but without the ADC that can introduce errors.