How is the switch wired? What code is reading the state of the switch?
Most push button switches are normally open. Pressing the switch closes the circuit. Yours does the opposite, opening the circuit.
The Arduino cares only whether the circuit is open or closed, so your switch, with the proper wiring and code, can work just fine.