I'm not sure if it makes sense to talk about getting a rotary shaft encoder and a stepper motor on a budget of $50. This should give you some idea how much the encoder could cost:
https://www.sparkfun.com/search/results?term=rotary+shaft+encoder
The stepper motor is another story.