168 Bootloader Error

Actually the fuse settings are the same for a 16 MHz clock and a 20 MHz one. You'll probably need to compile a new version of the bootloader that knows that it's running at 20 MHz instead of 16 MHz however.