Don't forget that the LEDs are being fed by a variable duty cycle.
I am using a 3.3V regulator fed from the 5V USB port (like on the Arduino) and the maximum current drawn by the AS1130 when all LEDS are on and at maximum brightness is about 245mA but this is only for a maximum 500mS as it then switches to the next frame.
I would allow 500mA per 11x12 panel..that should be more than enough (unless you have other stuff connected)