32u4 Bootloader activating during power glitch

I GOT IT! After doing some digging I laid out all the Fuse Bits and sure enough one of them was for Boot Reset!

I set that bit to false, modified Nicks code to write my new Fuse and it works as expected!

Now when I bounce the power line the sketch just restarts instead of loading into the bootloader, so no more annoying pauses if there is a slight glitch.

Here is my new High Fuse setup, I set BOOTRST to false (1) which fixes my power glitch issue, and EESAVE to true (0) so user settings aren't erased during an ICSP reprogram.

Writing fuses ...
LFuse = 0xFF
HFuse = 0xD1
EFuse = 0xCB
Lock byte = 0xEF
Clock calibration = 0x63
Done.

Hope this helps others out!