Solution found:
Keep the pinModes as INPUT while asleep, but simply restart the display again using
u8g2.begin();
after waking up.
(2/10/22) Edit for anyone stumbling across this:
you can use
u8g2.setPowerSave(true);
in order to prevent the little ugly bars from showing up when the display is powered off.