So far, searching the internet has lead me to "plastic" and "epoxy resin", which is a bit too general.
My guess is that heat will pop the LEDs before diffusing, but its worth a try.
It also seem that I've messed up LEDs by getting super glue on them (the fumes can diffuse the plastic).