Yes, need to "map out" the display being used.
I had to turn my 4 displays 90 degrees and re-wire them, (and then flipped the columns in the code anyway) to have the LED at Anode7, Cathode7 be the upper left, and Anode0, Cathode0 be the lower right.