You only need the 10k resistor.
Connect the Arduino pin to 5V using the resistor. Then use the push button to pull it to ground. Remember to set the pin as an input.
The logic in the sketch will be reversed. i.e. Low will mean 'on' and High will be 'off'.
The other way is to pull the pin to ground using the resistor and use the push button to pull it up to 5 v. The logic will not be reversed in this case.