On the due side, I hacked the USBHost lib that comes with the arduino ui.
In the meantime, I got audio out working (more or less) by following the instructions in http://arduino.cc/forum/index.php/topic,139279.0.html. Audio output still stutters slightly and latency is high (> 200ms).
I also checked the switch to alternate setting based on that version. It seems like the android devices switch but don't report the correct alternate setting.