RGB LED dot matrix display.

I'm gunning for a main frame rate of about 24 fps.

OK but where are you going to store the data that you are going to send to these LEDs? You have only 2K of memory so that is not enough for even one frame of a large array. You can steal some program memory but you only have 32K of that.

I'm currently working on getting supplies for a summer project of mine

Summer what year?

I think you should scale down your project and start off with just an 8 by 8 matrix to test the water. I think you will have enough problems with that.
This is my project that used in effect an 8 by 8 matrix, can you handle that sort of wiring?
http://www.thebox.myzen.co.uk/Hardware/Hexome.html