Solved my problem, the readings at the collector are actually not all over the place but slowly decreasing, I guess a capacitor of the sensor module is simply discharging.
And I can get sensor readings after figuring out the right sequence of Wire begin/end and delays to allow the sensor & I2C to wake up.
Franck