Fast efficient way to move memory

You could switch to a SPI-controlled LED strip type such as APA102 (aka Adafruit DotStar). I've clocked those at ~20MHz.