Yes, in theory that could be done and would save memory. Each 8x8 group of pixels would display one character, 64 characters in total, requiring 64 bytes.
Given the information in How the Matrix Works | RGB LED Matrix Basics | Adafruit Learning System
I can't see how you would multiplex the whole matrix without a whole array buffer.