Servo Motor Control

Ok, when I hold the button wired to pin 4, the motor rapidly wiggles back and forth. When I press and hold the other button, nothing happens at all.. I'm trying to get it so that once, say button four is triggered, I can use the sweep function to have the servo move to various positions without having to hold the button down.