Sounds like your voltage regulator on the arduino is not doing what it should. The 5v coming from usb directly bypasses the regulator so it will read the usb voltage. If nothing is plugged in the 5 volt reg is the most likely culprit.
outsider makes a good point though. Check the adapter for function and to make sure it wasn't the cause of the regulator dying.