For this project I think you need some way of displaying the current settings of your patch so you get feedback as to where the parameters are.
If you use pots then you could arrange the code that it only changes the midi parameters when you actually change the pot, not when you change the patch.
You have to read the encoders at about 1mS intervals so as not to miss anything. A rate of 200mS is way too slow.