Mistery: I2C not working, blink working

It may sound too simple, but how are you powering the setup? I have had I2C issues like this when trying to run from the USB power. Switch to a real power source and see if it changes your result.