A good rule to follow might be not to connect stuff to / disconnect stuff from chips while powered, but to turn the thing off.
Grounds should be connected, unless you know you want them separated.
Check every connection twice.
Install heatsinks when necessary.
And don't forget the most important rule, also known as the Fourth Law of Thermodynamics: If anything can go wrong, it will.