The dropout voltage for the 7805 is around 2V. With a 6V battery pack, you are gonna lose too much through the voltage regulator to get the full 5V. The board may run, but it could cause problems.
You should look into boost regulators. Or even buck-boost regulators for wider voltage inputs.