flip flop it or 4051 it?

Here's the start of the matrix. The anodes would be driven by a '574 wired as I discussed, the cathode by transistors.
This diagram used '374s (had them on hand) and the SPI pins to drive them.