4x AA Ni-Mh voltage drop on load

Where are you measuring that? At the power inputs on the regulator, or at the battery terminals?