Pin issue on UNO R3

Official Hardware Kits Starter Kit
11 
pinMode(pinNumber, INPUT_PULLUP);

Will turn on the internal pullup resistor for the pin and keep the pin HIGH unless explicitly taken LOW by some external action such as connecting it to GND