You don't have the columns & rows swapped, do you?
No; if I had, the polarity applied across the LEDs would be reverse and therefore no LEDs would light at all, so that's not the reason.
Do you have the scan limit register set to the number of columns connected?
I simply set the scan limit to 8. The connected digits are not the first five but I selected which ones to use based on easiest circuit routing.