There could be something wrong with it, or it could just be "cheap".
Sometimes you can bend the little tab inside (on the outside/ground contact) to make it tighter, and/or if the pin is split you can spread it out a little with an Xacto knife (or some other tool).