Why is Uploading any Sketch to the Due so Slow?

It gets much more interesting about 2.1 seconds after the first falling edge. This looks like it's probably the actual data transfer. Even then, check out the lengthy gaps. It's spending almost as much time waiting as it is actually moving bytes... and that's after it took its time (2.1 seconds) to even begin sending.