Just connect and use the internal (30K to 50K pullups).
Even the remote ones; they are not switching at high speeds, and unless your wire is really high resistance, the chip will read a low properly. Add a 10K pullup if you see any erratic behavior.
The small current is only 1uA when high, and thru the internal pullup will be 5V/30K = .17mA, having 20 low is only 3.3mA, that is not stressing anything.