Gotta be a better way...

Bobsled:
Then the 2 digit 7 segments on top have 18 pins each. So that's a current total of ~114 pins from the LED's that absolutely need connections.

That doesn't sound right. Do you have a p/n or datasheet for the displays?