The suggestion to short them to ground is to prove that floating condition was indeed causing readings with no input connected.
Connect then input to an analog sensor with an output between 0 and 5 volts to get your readings.
Do not leave the analog input floating else you will see some sort of signal when you expect to see none.