It won't do the Arduino any harm provided you are not drawing a lot of power through it. I have an Atmega 328 controlling my fridge 24/7 for the last 5 years.
Whether it is wise to leave a cell-phone charger running 24/7 is another matter that I have no answer for.
...R