Running Arduino on a battery.

You people just connect the raw microcontroller to a battery and your done?

Or do you use a stabalizing capacitor aswell?