Note that the 0.1uF capacitor must be of the ceramic type for it to work. This is because the ceramic type handles higher frequencies than any other type.
All capacitors have internal inductance and given a high enough frequency stop behaving like a capacitor and start acting like an inductor and hence stop removing noise.