jackrae:
In your case it could be the ceramic resonators that you are hearing (resonator being the key word)
The Tiny85 is using its internal clock. Could it be the decoupling capacitor?
Edit: It could be... google turned up some references to audible noise from ceramic capacitors.