I imagine the motor, like almost all motors, needs more current than the Arduino can provide. Arduinos are not intended to be used as power supplies. How much you can get will depend on how the Arduino is powered, something your diagram doesn't show.
Stick with an external power supply.
Steve