LCD doesn't display properly with 5v Power supply

I suppose you connected the 5volt supply to the 5volt pin.
Not to the V-in pin or the DC socket.

It might be 'safer' to use a 5volt cellphone charger connected to the USB socket.
Leo..