Hi, Many questions here:
WHAT are you switching with the SSR?
How is all this wired up???
WHERE is "Ground"...
Sounds like the usual "electromagnetic Interference" subject. Suggest you start here:
http://arduino-info.wikispaces.com/Arduino-Project-Planning-Electrical
Let us know what you decide...