Audio controlled slot cars.

Try smoothing it. A simple way would be to just increment the PWM value by one if the sensor value is over your threshold and decrement if below.

You may need to read less frequently too - either delay with small values or better of course, the blink without delay technique.