I appreciate the assistance, but my board followed the aforementioned schematic. Yes, I definitely screwed up with the external pull-ups, but at least the solution is to just remove them and let the Adafruit sensors do its thing. I'm just freaking out about whether or not I damaged the Portenta or not doing this.