Most of those breakout boards have pull-up resistors, linked to Vcc. Those may turn into pull-down instead when you power down the device, messing up the bus.
If you really want to save power it MAY work by connecting both Vcc and GND to GPIO pins (so yes, two per sensor), and then setting those pins to INPUT (high impedance) mode.