In that case it would be safe to wire the 5V leads of a 5V adapter to the 5V PIN on the Arduino?
Perfectly safe, that's what it's for (well, one reason anyway).
I suggest you start collecting old power supplies from discarded electronics, that way you will always have a power supply for anything you make.