how to reduce the electrical noise

Well without a complete wiring diagram including power source it's hard to give you specific advice, but yes proper filtering and bypass caps of appropriate size and applied correctly can generally deal with your problem, which sounds more like voltage sage due to load switching rather then just random circuit noise.

Lefty