ATtiny85 not working on battery power

Is there anything else I could do?

I also do not currently have access to a soldering iron.