Need quiet(er) servo to use with PING Sonar, any recommendations?

Power supply is 4 AA batteries, but also run it at times with an additional solar shield with 1000mAH 3.7v battery added to the mix. Grounding uses Arduino ground, power for servo uses +5v Arduino pin (all mounted on a mobile tank chassis - see avatar).

I was looking at the servo code, and had a thought. Can I connect the supply power for the servo to a digital out pin on the Arduino instead of the 5v out pin, and then simply drive that low instead of detach(), and drive it high instead of attach() (I'd do an initial attach() in setup(), like you normally would, but not before each and every rotate; instead, I'd just power on the servo before rotating, rotate it, and power it off, leaving servo "attach()"ed the entire time) ? There doesn't appear to be any "reading" from the servo part, only output to the servo, so I'm thinking I can just power the servo off, but leave the code believing it's on and attached under assumption that without reads, the code wouldn't hang waiting on any responses, but instead would just drive a signal line connected to a non-powered device. Would this work without damaging the servo? I'm tempted just to try this, but figured I'd ask and may save myself the cost of a fried servo.