Strange behavior with a continuous servo

Yup (I guess the servo wouldn't move at all if the ground wasn't connected to the Arduino?)