Can anyone explain a ground loop, and when tieing grounds together is needed.

Here's a link to a Popular Science article which explains ground loops (and other issues), from a 1958 hi-fi electronics (tube-based) perspective: