Arduino pro Mini 3.3 V powering issue

I am using the arduino pro mini 3.3 volts.

i have been powering an RTC chronodot, the 1306 oled Monochrome 0.96 128x64 OLED Graphic Display - STEMMA QT : ID 326 : $17.50 : Adafruit Industries, Unique & fun DIY electronics and kits, ms5541 pressure sensor http://www.meas-spec.com/product/t_product.aspx?id=6731and openlog SparkFun OpenLog - DEV-13712 - SparkFun Electronics.

all of this is for my diveduino www.diveduino.com

i have been powering this with two AAA batteries, it works great i have push the batteries to write the sd card 4300 times. after that amounts of writes to the openlog module, i think the battery voltaje drops down to 2.7 and the open log module no longer records, but the display, rtc, arduino and sensor keep working....

i was wondering what other options are available for me to write more times.

Erm 2 AA batteries? Higher capacity AAA batteries? LiFePO4 cell (these are pretty much spot on 3.3V BTW)?

i am using one of this and it is working perfectly...