It happens the same to me, when using the programming port with the Arduino Due, I can only connect to the Native USB.
That would be logical. The programming port is for, well, programming the Arduino. You aren't programming the Arduino from the Terminal application, are you?