I apologize for the lack of information. I'll try and fix every thing in this message.
1: I accidentally had my schematic backwards, so here is an updated one.
2: I'm using Arduino to power the device, and Arduino as ISP to upload the code.
3: I'm using ATTINY Core.
If I'm missing anything else please let me know.
Thank you