USBKeyboard.h occasionally hangs

It appears from your sketch that you are not even reading your input button. Your just sending down arrows. And you are saying that even this hangs? That would kinda rule out any switch bounce.

Does this mean that if I use your library, my virtual keyboard is going to hang as well?

I will let you know my results.