This sounds very similar to something I had happen with a 328p chip. Which bootloader are you burning?