I am trying the same thing. I made it work about 10 minutes ago by "porting" parts of the USB Host Shield 2 stack. It's basically renaming "USB" class usages into USBHost as well as renaming quite a few uint8_t into uint32_t in the virtual methods.
I will do a clean port of it again and wrap it up as a library. If time allows I'll also write a short readme on how to port host shield stack drivers to the Due.