You need to provide more details, like how much current your rig draws, its size and weight, to give us some idea of what batteries it could carry.
You may be able to use a 6v battery & drop the voltage near enough to 5v using diodes instead of a regulator if stability is not that important.
If you can use 4 nicad or NiH cells, the 4.8v may be close enough.