I'd scrap this code, and rewrite it as a state machine, with properly debounced switch inputs and no delays.