Simulator control surface project- advice needed (lots of digital inputs)

The internal pull-ups are pretty weak, about 30k. Try adding 10k external pull-ups instead. I have no personal experience with encoders, but you mentioned it seems to work fine on your logic analyser with 10k pull-up resistors.