Hi,
Your Piezo is just that, a Piezo element and it is responding to the DC you are applying to it.
I think what you were expecting was a BEEP.
You need to get a BEEPER.
OR make the output of the Arduino, oscillate at the tone you would like to hear.
Tom.. 
PS. Write some code to just drive the Piezo.
Try Tone library.