Your description sounds correct.
How was your arduino powered?
Do you have a multi meter? What voltage is your battery actually providing?
Can you tak a pic of your setup and post it?
edit: your 4.6v is slightly below the specified 4.8v minimum voltage for your servo. Not sure if this would prevent any movement. Is that the same pack you use to power your RC receiver?
I'll attach a pic that I frequently use to illustrate the wiring.
