Arduino Due: external power supply and USB connection

It could be because of the ground connections I'm talking about. Please post (edit -larger) images of your actual hardware. Generally we need better diagrams.. for example you talk about "pin 5" - it's a struggle to identify that on your diagram...