I'm not trying to blink an LED. The code i posted here is just an example to demonstrate the problem I'm facing in my original program.
That is not the point.
What you do is to make a note in the ISR of the millis time when you do what ever you want to do in it, then the next time the ISR is called you return immediate if insufficient time has elapsed because then you know it is a bounce.