CrossRoads:
Get a wallwart for now.
http://www.mpja.com/5-Volt-DC-Plug-Power-Supply-4A-Regulated/productinfo/18520%20PS/
Replace with a 2-cell (7.4V) high amp-hour LiPo later on when you've determined your actual needs.
Can you recommend somewhere I can buy the female part that I can use to plug that power supply into my protyping board? I don't know what to look for