Power Supply slowly drops voltage after switching off - problem for arduino uno?

No need to burn the bootloader! Just burn the fuses. avrdude can be run directly to do this.
http://www.ladyada.net/learn/avr/avrdude.html