Oh - don't forget that it will be consuming additional CPU cycles in the ISR, which will be an additional problem if you're really short on total cycles. It's not clear whether your current tests are showing any of that time. (If you do a write once a second, the interrupt is going to occur essentially immediately.)