BenF, thanks for the very useful reply.
When I accidentally overwrite the programmer, that is within the bootloader right? So I should be able to reprogram it as usual, with just the Arduino board, over USB.
I'm still not sure when the bootloader is overwritten and when it's not. Anyone any comments on that?