Programming AVR (ex attiny2313) using Arduino IDE and Arduino board

Ah. Now it makes sense. Sounds like you need a better power supply.