What is the input impedance of the control voltage input you're feeding with the pot? If it's quite high, you could eliminate the pot entirely, just low pass filter a PWM output with a resistor and capacitor, to emulate an analog control signal. Fewer and smaller parts...