USB Serial Baud Rates? ... or other faster USB communication methods?

1843200 baud

the due with its 84 MHz clock should be able to send at this rate, but for the receiving end it means ~184K interrupts per second that data is received. or 5 uSec to handle one. That might be the real bottleneck.