Power arduino on with push button

Do you mean hold the button down and it goes to sleep? If not, I suppose you could make a circuit that would turn the Arduino off. But I don't know how you could turn it back on without outside assistance. Opt for the sleep if you can spare even a microamp.