Here's schematic that I came up with for 4 MAX2719 chips. I just started to learn Eagle (pretty much my first diagram), so it might be laughable, but hopefully it's correct 
I connected common Anodes (SEGA-G pins) together, but Eagle is cursing with Errors "More than one OUPUT pin on net N$...". I hope I can safely ignore those errors...
Now just looking at PCB mess I'm already having nightmares
BiColor_2Matrix_02.sch (497 KB)