Another Millis Timer off question...

You might want to look at change in state detection when handling buttons.

When a button is detected 'just-pushed' or 'just-released' you set a timer to current millis(), you then check the timer to see if times up.