Coin cells on a stock arduino board are crap - due to power wasted for led, regulator... you will need to remove the leds, and i'd pull the reg too.
When I run off LiPo I run it right off the battery (ie, at 3.7v), so no quiescent current of reg to worry about, and a few less parts.