Yes.
This is the boot-loader doing its thing at power up.
If this is to be avoided, you can program the sketch in the Arduino using the ISP method of programming.
However, it might be best to leave things as is since using the built in boot-loader, that arrived in the chip, is a more convenient way of programming your sketches to the Arduino.