Another interesting thing is - why does this only happen if the USB cable is plugged in?
Any ideas how I can fix the problem?
First eliminate any other possibilities, like cover up all the IR sensors and emitters. If you still got problem, then it may indeed be EMI. Try a common mode choke to isolate the trouble spot.