ATtiny85 not working on battery power

That battery pack is 3 volts. You need to set the Attiny85 fuses to disable the brownout feature.