ground loop issue

So its possible that 330mA is not enough?

Yes it is totally possible.
Try a power supply with at least a 500mA capacity.