RTC acting strange

I'd stick the battery back in. From the datasheet:

A lithium battery with 48mAh or greater will back up the DS1307 for more than 10 years in the absence of power at +25°C.