I then try to upload the sketch
So close but so far - I changed the programmer to Arduino as ISP and uploaded via programmer. The LED flashes like crazy for about a second and then turns off. Any ideas?
Try it without the cap between RST and GND. My arduino as ISP works without it.