Issue using the 3.3V pro mini board

Power into RAW goes thru the 3.3V regulator.
Connect to VCC instead so you get the full range of the battery.
That will allow the MOSFET to turn on more fully (and have a lower Rds, or On resistance) to allow more current flow thru the motor.