I would say the only thing you are going to struggle with it the 16 rotary encoders. These need quite a lot of looking after.
You are going to need plenty of port expandars to do this, I would make my own but you might have to look into getting a shield.
Make a list of how many connections you need.