You can add a small diode to the 7805 ground like below to up the 7805 output voltage to ~5.7v for better servo performance.