i wanted people to look at the schematic
What schematic all you posted was a physical layout.
No not conect a battery directly to the 5V line you will blow up the arduino or your USB hub. It would be wise to also include some capacitors on the power rails.