Well, gave it another shot and still nothing. I tried changing the DC line, still nothing.
I did connect up my Bitscope and the signals are ok. I also loaded another sketch that uses the i2c 4x20 display (which was still connected with the oled) and all runs.
I'll have to research the Spi thing and change it back to try that way, maybe I just got a dud.