Battery powered arduino Device

Did you try everything in Nick Gammon's reference work?

https://gammon.com.au/power