A little timing jitter should not be a big problem at 100Hz.
Nick Gammon wrote a very interesting page about interrupts and timing : Gammon Forum : Electronics : Microprocessors : Interrupts
You can read on that page that an external interrupt takes about 5 µs plus your own code.
Keep the code very small, for example only increment an integer, and do everything else outside the interrupt routine.