Power advice with only AA batteries

Hobby type R/C servos don't NEED 6V, their typical operating voltage range is 4.8 to 6vdc.

Well, the lower voltages are ok when only a rudder and other light loads are being moved. If the servo is expected to hold/move any real load, 6v will be much better. Check the torque specs for servos operated at 4.8v and 6v.