Seeedstudio sells a "LiPo Rider" that might be what you're looking for. Sparkfun sells something similar.
TI's LM1117 datasheet shows how to build a battery backed power supply (page 20) that might meet your needs. That circuit should have something added to prevent overcharging the battery (zener shunt regulator, etc.).