As long as you can operate the appropriate CS pin on the pots I imagine you can use as many as you like. You could use a port extender chip to get more pins on an Uno - or use a Mega.
I presume the pots are going to control an amplifier for each speaker
...R