Other way around - use P-channel MOSFET as high side switch with pullup on the gate to hold it off.
Press a button to pull the gate low & turn on the power, Arduino comes alive & holds it low to keep power available. When done, release the gate & MOSFET gets turned off, power goes away.