The electronics in the servo are the motor controller.
With the ability the receive instructions as a servo and make the motor spin forwards or backwards.
If you want to drive the motor directly you will need a motor controller.
You cannot power the servo motor directly from the arduino pin.
Why did you remove the controller?