You need a resistor not in the common connector but in each of the other side. I am not sure what you have got but if it is a common anode you need resistors in each of the seven cathodes.
Are you going to multiplex them? I think you need to in order to get diffrent numbers to be shown on the four diffrent displays.