Is there a way to make it so that if the button is help down for an unspecified amount of time and then let up, it only counts as one button press?
The pin state will read one way while the switch is pressed, and the other way when it is released.
By keeping track of the state from the last iteration of loop, you can tell when the transitions (to pressed or to released) occur. When you have detected a transition, the current state of the switch (pressed or released) defines which transition occurred.