I also power my Arduino (I use Nano mostly) using 4 rechargable AA cells delivering 1v2 each (will make 4v8) and connect that directly into the 5v of the arduino. Works like a charm!
I've also powered some with a 5v powerbank wich works surprisingly well! Big advantage is, that you can charge it with most common adapters, or a computer/laptop.