I thought the idea was that adding a diode would increase the voltage at the 7805 around +0.7V?
That's correct. Check how you have the diode is installed. You may want to remove the 7805 from your circuit and get it setup standalone first. "Breadboard" drawings are not useful to me as I don't use breadboards (have a nice one, but never used it).