Button (INT0) interrupt freezes interrupts for 1 sec... stop!

But do interrupts based off an external crystal run continuously with the program? I can set it so that it is always on, and the clock runs fine, but I can press the button and the ext clock doesnt pause.