Interrupts fire Randomly

If you want reliable results, avoid floating pins at all cost.
Depending on how your switches are wired, use pull up or pull down resistors.