Power Arduino Micro via 3.7V Lithium Polymer

Pololu makes some, very little boards.

Test with one to start, one with autocutoff if voltage goes too low so you don't kill the battery by overdischarging.