what will this effect?
Sketches built for that board will run correctly at 8 MHz.
Do I also have to fiddle with the bootloader somehow?
Possibly. To upload at 115200 baud, you will need to install a bootloader built to run at 8 MHz. You may be able to halve the baud rate and leave the existing bootloader.