Yes, those are caps.
I don't think there will be any pull-ups on the board, but the Wire library enables the internal pull-ups. Many i2c slave modules (sensors etc) often have pull-up resistors fitted, so combined with the internal pull-ups, this is often sufficient, as long as the wires are short.