What about measuring a voltage that can't have a common ground with the Arduino - for example the voltage across a shunt?
Fine although you are not measuring a voltage you are measuring a current and you are making the arduino's ground common with the external circuit.
But this is not the same as a floating voltage, if no current flows then there is no measurement. And if the voltage is floating then ther can be no current.