Input pin - Default State

[system]

...but there must be a way to disable that pull-up????

Actually you set it with digitalWrite(pin,HIGH); and if you do not set it, it is not enabled.