You need pull up resistors to the 3V3 line as well as disabling the internal pullups.
From what I read you also need to supply it with a 10MHz clock signal in order for it to work.
I assume you haven't just got the raw chipp, so what else is on the board in terms of regulators and such?
How are you powering it? The 3v3 output line on the aeduino has limited current capabilities.