The battery allows for faster satellite acquisition. The battery basically keeps the SRAM storage alive, which contains an almanac of satellite position information and data. If you fire a GPS up for the first time, it will generally take longer while it downloads the almanac from the satellites.
The battery helps keep that Almanac in memory, thus making satellite acquisitions faster.