Trying to understand pull-up resistors

Imagine a pipe of water, we can have current/voltage, which is the water flowing, when the water stops flowing, there's no more water/current.

That's not a good analogy; water represents both current (flow) and pressure (voltage). Even if there is no water flowing out of a tap, there is still pressure.