Time to buy glass.
My thought is that if glass can focus and refract IR light as well as reflect it, it will be able to diffuse it too.
By the way I already tried with frosted acrylic and a laser pointer and it worked great.
EDIT - Can't find anyone who sells glass...