What are the resistance values of the pots you are using. Too high a value can give you 'jumpy' numbers. 10K ohms or less are best to use. Also servos usually can't process new values much faster then 25 millisec so you might want to increase your delay() values a little.
Lefty