PaulS - "Nope, doesn't happen to me and my Arduino." from 43 people would at least confirm to me that it wasn't normal operation.
k2pek2 - Thanks for the response. Presumably it's some kind of initialisation of the pins on connecting to the usb socket.