My very first "non breadboard" circuit!

Check the wiring, seems one of your motor wires (enable perhaps, or maybe something else) is hitting the servo's signal wire.