johnwasser:
I would note the time that each whitelist entry was last seen. Scan the list occasionally (every second?) and if the the entry is marked "entered" and has not been seen for more than 30 seconds, mark it not-entered.
Thanks for the advice!