Since this thread was resurrected I am going to mention that Maxim has a part that does specifically what the original poster asked for, it controls 1-4 5x7 matricies. Who would have thunk it?
http://datasheets.maximintegrated.com/en/ds/MAX6952.pdf
Maxim has a bit of a premium on this chip but you can always ask for a sample.