Help with Servos and SPI for RGB matrix

[system]

So the timer is obviously the problem.

Yes. The Servo library uses the timer you are diddling with. You can either use a different timer for your use, or use the ServoTimer2 library, which uses a different timer for the servos.