Servos are not designed to be powered up but with no control system, so the manufacture will not give you a behavior in that state, so you can only test to see what happens. Also you need to make sure the arduino servo output pin is set to LOW output so current won't try and flow to the servo when it's powered off. And most likely a jitter will happen when you attempt to re-power and re-attach.