Is my 8x8 display broken or am I doing this wrong

Jrodenba:
Sorry, I just realized I posted this to the wrong place, but it won't let me delete it.

No it's the right place as this is an LED matrix not a display.

and got some pretty funky results

Not very scientific, nor useful in conveying to others what is going on.

I am rigging it wrong

No idea as you haven't told us how you are rigging it.
You need to post a schematic ( a real one not a fritzing abortion ) and you need to post your test code and say what it does and what you want it to do.