But only when I have the Arduino connected to the USB
When the USB to serial converter actually has something to do.