We strongly recommend that beginners work through the example projects -- blink an LED, read a button, a voltage, a temperature or light sensor, control one servo -- in order to learn the programming language and the special features of the Arduino.
If you don't, expect endless frustration in an advanced project such as the subject of your post.
I can make it sweep with potentiometer, but that's where my ability ends.
This is a good start, but it sounds like you don't understand what the program is doing. Make sure you do before moving on.
If you want help with an example program, post it properly, after reading "How to use this forum" and ask specific questions.