It is possible you have the LEDs backwards? Try swapping the Digit and Segment drivers to drive the LEDs the other way.