So really, you're adding extra electronics as sort of an enable line for what could be envisioned as additional layers, or sections of the 2D matrix.
Could be as simple as 74HC125 gates, where the switch is allowed to drive the matrix when the output is enabled. Or something larger, like the equivalent of 74HC244, with 1 enable to support 8 Ins & Outs.