If the button is between +5 and the Arduino pin you need a pull-down resistor between the Arduino pin and Ground.