See the thing is I didnt have to do half of that. I removed the chip, plugged it into my arduino board, programmed it, removed it and put it back in the circuit. I tested it with the regular Arduino ports and everything worked perfectly fine.
But then I tried it without the serial communication. I disconnected the RX and TX connections and uploaded a blink sketch:
const int ledPin = 13; // the number of the LED pin
void setup() {
// set the digital pin as output:
pinMode(ledPin, OUTPUT);
}
void loop()
{
digitalWrite(ledPin, HIGH);
delay(1000);
digitalWrite(ledPin, LOW);
delay(1000);
}
And this failed to work as well.
Here is a picture of my circuit:

By the way, I tried multiple chips brand new and they all didnt work. I tried several batteries as well. I've replaced every component and breadboard too.