Arduino push button not responding when in line with resistor

Do you mean with "remove just the orange wire from the connection" the one I connected to the 5V?
Arduino Tutorial Step Motor with Push Button Part II - YouTube (0:10 represents what I have)