ATtiny85 not working on battery power

Plugging the 10k resistor between reset and Vcc doesn't appear to do anything. I do not have a ceramic decoupling cap on hand currently.