Mapping 64x32 led module with arduino

I would imagine the mega is the weakest component and probably not fast enough for this task, especially connected to the esp-01 by a slow serial line. An esp8266 or an esp32 module would be a better choice to replace the mega, and would simplify things in some ways. But for something like this I would look at raspberry Pi of some kind, like a zero-W. Perhaps someone has used one of these to drive a similar display?