All that I can suggest is to carefully check your wiring. The symptom suggests that the button input is floating (not connected). There will be a delayed response due to the delay()s in the stepper loop, but the LED should be on when the button is not pressed and off when pressed (using the code in reply #5).