Yes that is the idea, although you. Although you might get away with not having them on the lower current devices like the LCD.
I am not sure why Paul said that. In general you do not want to make the capacitor that big wired directly across the motor, just a 0.1 uF ceramic. You want the large one across the motor supply not the motor itself. That is the motor and the driver be it simple FET or h- bridge. When you do then you can put an inductor in seriese with the supply and a capacitor the other side. This is known as a pi filter because it resembles the symbol for the maths constant. Google for an example.
There was a question recently about how to claculate it's value and things got rather over heated. Basically every one was right but some were arguing from mistaken premmisis. (that is probbly a spelling joke - a dyslexic on an iPad is not a good combination as the spell corrector is rubbish )