melka, I hope you don't mind I started with your schematic and did some of my own adjustments. Besides flipping the components so they nestled on the "top" layer between the PCB and matrix, I made these changes.
(1) I corrected the pin spacing for the GYXM-2388AURPGB parts that I got from LEDsee.com. You were slightly off the grid left/right for a couple of the pin spots. The two rows are 1.9" or 19 pins apart.
(2) I reordered the anode pins so the rows are in QA,QB,QC,...,QH order from the anode driver.
(3) I took Anachrocomputer's suggestion, and tied the R, G and B chips' "G" aka "/OE" pin to a sixth input called DIM on the jumper. I did it on the cathodes and not on the anodes, because I might want to fine-tune RGB balance with separate PWM inputs sometime (not in this revision). If the user doesn't want any PWM support, they can supply GND connections offboard.
I'll supply EAGLE files back after I take a little more time for review.