Zoomkat, sounds like you have a busted regulator.
I then powered the board with another 7805 connected to the arduino 5v pin and things then worked as expected. The arduino was an early ebay board, so the onboard 7805 could have been bad from the start.