How do I stop an Arduino sketch?

"I would even like to rewrite the program to just move the servo a couple of degrees and then stop/pause until I tell it to move further. "
That's how you stop it - let it do an action after it sees a button push, then it goes back to reading the pin/port ready to act on another button push.
Or reading a serial port. Or taking analog samples.