I have 'regular' buttons soldered and wired as I learned : one pin to the +, the other pin to the breadboard. On the breadboard I connect it both to GND as well as to a 10kohm resistor. On the other end of the resistor a wire to a GPIO pin.
This works, but : when I press the button, other displays and LEDs dim. And OLEDs stop or show scrambled text.
Sounds to me that when you press that button there will be a short-circuit, causing a voltage drop which could cause problems in the rest of the circuit or even damage.
Disconnect it immediately and learn how to wire buttons correctly. Wherever you learned from last time, don't go there again!
With INPUL_PULLUP the pin is normally HIGH and LOW when the button is pressed.
You also must adapt the code for that.
INPUT_PULLDOWN: crafty, but not many Arduinos support that.
Leo..