Hi, how are you supplying the servo with power, if from the Arduino this could be causing the intermittent problem.
The servo can overload the 5V supply in the Arduino, in all cases it is suggested that the servo be powered from a separate supply.
Tom.. 
Can you post a CAD or picture of a hand drawn circuit diagram please, even a picture of your project if possible.