Does Arduino start automatically

yes, the arduino will run your program when powered by battery,
although, like when you boot up a p.c,
and it takes a few minutes,
the arduino will take about a 2 second delay.
hope this helped