Counting

therefore the interrupt only last .1mS

"only 100 microseconds" is equivalent to up to 1600 AVR instructions.
That's really quite a long time.