Wiring the button for active-HIGH or active-LOW doesn't have anything to do with debouncing.
The discussion linked below about how to program a button is good. The main opinions are that having a lot of accessible+5V nodes in the system makes it easier to short out and damage things, and that the PULLUP_INTERNAL is simpler to wire while also being more protective.