You need 5 volts for an Atmega chip, not 12.
If you have a well regulated 5v power supply, my guess is you could skip the regulator and just put in some caps as an extra measure.
A reg doesn't take up that much space though..especially if you leave it
mounted vertically (TO220 package).