I would put a P-channel MOSFET on the Vcc of one side. It should switch off if the other side has power.