switching comunication pins off

Tri-state or open-collector outputs on all devices that drive the matrix would probably work.

Would probably be better, especially in the case of two arduino's, to just have one arduino control the display, and the second communicate with it when something needs to be displayed.

Very unlikely you will find a library with commands to support something like this, since it is so unusual, and generally easier to handle in software instead of hardware.