Again, I don't have the time now to check the Portenta input specs, but you could remove R1-R4 entirely, and apply only 3.3V to pin 1 and pin 3 on your J2. That would enable the 3.3V pull up resistors on the HMC.
If you used this circuit on the Every, it's also wrong.