Transistor + Arduino (Extream sleep mode of 0mA)

Pololu has a nice little MOSFET pushbutton power switch that seems to do just what you want: Pololu Power Switches