Max7219 won't shut off LEDs

I just tested it with a single LED hooked up to the MAX, it immediately lights up when I plug in the arduino.