Well the issue was that when I sent the signal to turn on the mosfet sometimes it would work and sometimes it wouldn't.
I noticed that every time it didn't work I would start trying out new mosfets and they would work during the same time and when I tried any one of them about 2 days later neither would work even though they did work a couple of days ago.
So I've noticed that if I let the setup sit for a couple of days and try to turn it on they fail. But if I touch the back plate slightly they work.