Decoupling shift registers

Sure, that's easy. So it just needs to connect VCC to any GND, and not specifically the GND pin on the IC? Another possibility that I noticed was to stuff the cap down in the middle of the socket with the pins sticking out the bottom, but the caps are too big and don't allow the IC to sit all the way down in the socket. Would that be ok as long as the IC is still pretty secure and can't move/fall out?