Awesome thanks so much for your help! I just tested it on breadboard and it worked perfectly as you said to do so. I am making a attiny84 proto board with 14 inline pins to easily plug into a breadboard, my first ever PCB circuit I made! Did it earlier and it came out perfect, so now I just added the reset switch to it! I still have a 5v 500ma regulator to put on there too yet.
Pics from before I added the reset button :).