Relay vs christmas lights

The leakage rating for this SSR (Omron G3MB-202P) is 1.5ma max at 200VAC.

Assuming the actual is 1ma actual it is likely the LEDs driven with this current will be able to be seen.

So Yes it is normal.