Sorry I didn't understand why? is the wiring so wrong?
No,No. I was trying to make a small joke.
It only takes one bad connection or component with all of those leads on the breadboards to cause a failure.
Sometimes I can spend a couple of hours trying to make Adruino as ISP work and then the next couple of times it works really well. I don't have this type of problem usually when using a USBasp.