Just in case this is any help to anyone reading this thread...
I had similar issues using a usbasp programmer to program an ATTiny85.
The solution I found in the end was to use 5V instead of 3.3V (there is a jumper on my usbasp that selects the voltage that is supplied from the programmer board - which I was using to supply the board)