A sketch with nothing but empty setup and loop functions uses just under 1k of program memory. These are for some of the core arduino functions like the interrupt handlers that will be used when you start using millis and analog writes.
If want to use Arduino functions then you do need to have that code. But I think you may be pleasently surprised how much stuff you can do within the available program memory.
Have fun!