Audio and LED Matrices Not Working Together

Hi,

I've been working on a clock project that uses four LED matrices (I2C) to display the time, as well as an MicroSD Breakout (SPI) and 8Ω Speaker to play a couple cool sound effects.

I've gotten the LED matrices to work. I also got the audio to work separately. However when I combined the circuits and code, two matrices go out and the audio is just garble.

I am using the Adafruit LED_Backpack library and the SimpleSDAudio library. Is there any way to get these two libraries to work together?

Please help,
Desmond