Thank you all! It was the power supply. I was using a 120v to 5v phone charger type power supply and I changed to a different on and now it is working as it should.
The weird part about it is the same "block" power supply that I was using to plug the serial cable (micro usb) into was the same "block" I was using to run the 5v out of to the 5v pin.... Not exactly sure why it didn't work, but I have it going now....
Thanks!