Servo motor grounding issue

With few exceptions, you want all grounds connected together.
You don't say which buck converter you are using, but the input and output grounds are normally connected together on the PCB.

pololu