I'd use an XMOS system for that. The $99 XC-1A board has a four-core XS1-G4 device with eight hardware threads per core - 32 threads. A UART can be implemented in each thread, and the board has a built-in USB interface.
Arduinos could be used, but the solution would be a lot more expensive and complex.