Arduino only works when connected to USB

Yes correct.