With the 2V drop from the 7805 regulator and the .6V drop from the protection diode, you'll be operating well below 5V.
It may operate OK at the lower voltage, but don't try to burn a new sketch! It can corrupt the bootloader and render your Arduino useless until you get the bootloader re-burned.