Using Computer Power Supplies?

Check whether your power supply has any minimum current requirements. It may be that you need to keep a certain minimum load on it to stop the output voltage climbing.