Found a thing.
Apparently near-IR light like the wavelength I'm using (980nm) will pass through glass just fine. But after roughly 2000nm it starts being absorbed instead of ignored.
EDIT - It appears that acrylic is the same way. I will test by putting different materials in front of the TV and trying to change the volume.