Arduino UNO + Pololu USB AVR Programmer : issues

Sounds like it is working just like mine does. Try this from the command-line...

avrdude -v -v -v -patmega328 -cavrispv2 -P\.\COM5