Thanks for your answers, guys!
In an application where instant-on is needed this is undesirable.
Guess in my case it won't be a problem, as it would be an always-on device, such as a door lock, waiting for a code to be pressed in or a card swiped or even a command coming from the ethernet and such.
Keep the bootloader so people can easilly steal your code lol.
You mean I can remove the bootloader, so that people won't be able to get my code or install their own, and the chip would still work without it?