It may be worth putting a current limiting resistors in series with your 5V and ground ICSP pins then.