Works fine powered from USB works bad powered externally

Thank you.
About 5V regulator - I mentioned that I tried to use it but after I've seen it didn't help I removed It.
Now the Arduino powered from 220 to 12V adapter (on the right). Its output connected to Vin.
Yes, I also think it is grounding issue. But I don't know how to solve it...