For what you are doing, connect ALL the grounds together, including the ground pin on your wall outlet. IF you have one of those cheap detectors that show the power , common and ground are correct for that outlet, use it to be sure the ground is really a "ground" and was not left unwired.
Paul