When a servo loses its ground connection to the arduino/servo power supply common connection, it may behave erratically. Sounds like you are somehow breaking this connection when you connect.
When a servo loses its ground connection to the arduino/servo power supply common connection, it may behave erratically. Sounds like you are somehow breaking this connection when you connect.