I would counter that safe or not, those small 9 volt batteries are really a very poor choice to power an arduino board. They have very little current capacity and as such cost more then nearly any other type of battery choice you could make. And if you don't require portablity then you really should be looking for inexpensive wall wart power modules to power your board(s) over using batteries at all.
Lefty