When it all works correctly, is the Attiny85 removed from the breadboard and plugged directly into the programmer ?
If so, the review all the responses in this thread related to quality of connections, decoupling capacitors etc.
It is, anyway, unusual to socket an integrated circuit on a breadboard. Remove the socket and plug the chip directly into the breadboard.