DrAzzy:
Or you could move to 328PB - that one has proper pin drivers on those pins. And IIRC it has 2 more pins too (they replaced a Vcc/Gnd pair), and more features.I think Minicore supports it, though there are still some complications...
328pb is about 70 cents cheaper on Digikey and if I don't need physical pin 3 or 6 I could leave them connected to VCC and GND as input so my PCB can have either 328p and 328pb