Trying to use Arduino Uno R3 as ISP for ATTiny2313

Another thing to try is moving the chip to another spot on the breadboard or another breadboard.
If have experienced bad contacts on one mine, althoug not shortycuts.