If your power supply is inadequate to power the servos, you are simply wasting your time.
Alkaline AA cells can output 1 ampere FOR A FEW MINUTES and then they are useless for servos.
NiMH AA cells (use 5 for a 6 volt power source) do a bit better, but not much.