The device cannot tolerate pullups or pulldowns unless very very weak (greater than 50k). It only drives weakly in the steady state, with strong drive only on transitions. Its a smart device.
So if you are worried about initialization time use 100k pull-ups / downs and enable the outputs once everything is set up. Otherwise just hard-wire the enable on and it should "just work".