I've double checked my perfboard, there were actually a few missing connections, but the I2C lines are the way they should be.
Could there be a clue in my schematic as to why it's still not working?
Click on image for larger view.