Zigmund:
Other than usual decoupling with a pair of capacitors from each analog input to ground would anyone have a suggestion what to do? I hesitate to use capacitors to not affect the sampling speed...
Have you got decoupling capacitor on the arduino's DC supply pin to ground as well? Could put some there too.