The 'problem' you're having isn't a real problem. It's called a floating ping. If you would add a 20K or 10K resistor from input to ground, it will be gone, and you will have a 'normal' input. See http://www.arduino.cc/en/Tutorial/Button for a shematic.