So if the display is indeed designed for 5V, have you attempted to connect your power supply directly to the display?
Can you identify your supply? Can you tell us what the current capabilities are?
In general if you are going to continue and play with such circuits and devices you should get a multimeter. You don't need an expensive one. In this case it would help if you could measure DC current.