Take what JimboZA said about potential difference between two points and what pwillard said about references, combine them.
Ground isn't special, it's just a reference. Different points in a circuit that are tied to ground may have slightly different voltage potentials. This creates a loop.