Yes, you can program the chip inside the arduino, then pull it out and use it as a standalone...
here is a good lesson on how to set up the atmega without the arduino:
http://itp.nyu.edu/physcomp/Tutorials/ArduinoBreadboard
Arduinos (those with the dip atmega chip) come with the chip in a socket.