You have a lot of delay()s in the sketch. The Arduino can't read the switch while in a delay(). So if the sketch spends 90% of the time in delay there's only a 10% chance of reading the switch, so to speak. A responsive program can't use blocking functions like delay(). Perhaps the several things at a time sketch will help to understand how to use millis() for timing and avoid delay().