middle pad on 328P

How critical is it ground the middle pad on the 328P QFN/MLF chip?

Quite.

NOTE: Bottom pad should be soldered to ground.