There is a problem with solid state relays when it comes to switching very light loads, which is what you have. You might have to put an other load in parallel to make it turn off correctly. Something like a 20W light bulb or a small heating element.