What about the bootloader?

@Graynomad, So do you mean that, if you buy a SAM3X8E from Atmel, it already comes with the necessary bootloader, and you can USB-upload Arduino sketches to it as purchased (assuming the UART interfacing in between is taken care of) ?

(Now if only it were in a hobbyist-friendly package!)