JoeN:
The fact is that the wall wart isn't really a regulated supply ...
Certainly some are. And some are not. So be sure about the particular wall wart in question. Wall warts like this one are usually plenty good to connect directly to the 5V pin (not to the Vin pin).