UNO board I2C pullups? Can be enabled/disabled?

Using Arduino Networking, Protocols, and Devices
18

Then I put an 8 ohm speaker on the output.

Yep that would screw it.

But I didn't think the I2C system would be damaged.

Well you never know what is going to be damaged because you don't know how the die is laid out.