ATtiny85 not working on battery power

You also need to solder header pins to the processor board. The holes in the board do not otherwise provide reliable connections.

There are plenty of good soldering tutorials on line (e.g. Adafruit and Sparkfun).

Edit: I was looking at the wrong photo, but I can't tell from either photo how the processor chip is mounted in the breadboard.