In a recent project I read 4, using polling, on an ATMega328p (much slower than your Pi Pico), using an existing rotary encoder library. So apparently it can be done...
My project did the same, albeit reporting data over I2C on request by a master. It doesn't miss a beat. No interrupts needed for the rotaries.