Step-up or Step-down regulators for 3.3v

Yeah, I guess it would depend on the type of battery, its fully charged voltage and its depletion voltage. Batteries with overall voltage of 12V or higher would only need step down regulators if regulating to a voltage below its depletion voltage. The battery specs should give some useful information.