How come my MOSFET was a "smoking", I thought it was rated high enough.

Whats the gate - source voltage on the large mosfet?
To turn it on hard so that its dissipation is low, you will need close to 20V.
5 V wont turn it on hard , so its dissipation will be high, hence the heat build up.