If your switches are wired input to ground with the internal pullups enabled you can add a 0.1uf cap across the switch to prevent bounce and eliminate the possibility of that being the cause, although I really think the delays are responsible. Once the sequence starts, the switch is not read until the sequence finishes. Then the switch is read at the top of loop() and the program goes right into another sequence. The time window for switch reading is pretty narrow.
