groundfungus:
Do you have any debounce on the switch? The switch bounce will trigger multiple interrupts. How is the switch wired? Attached is the more accepted way to wire a switch. This way allows hardware debounce and the use of the internal pullup. If hardware debounce is not enough, you can add debounce in software.
I've added HW debouncing as in your picture. That fixed the CHANGE, RISING and FALLING modes, but the LOW mode is yet not working as expected.