Your power supply probably has a transformer and maybe it is a switching type. If that is the case it could produce EMI "electrical interference" that could easily "test" your Arduino for weaknesses. If you can get it away from you lcd and Arduino you can eliminate it as a cause of your problem.
Mark
muda:
