Mega 2560 Rev. 3: Not Working Without Initial USB Connection

I got it working again, I think it was a flaw in my code.