Control audio to 3 speakers

Using 3 switches, I went to be able to turn on or off an audio sample in 3 different speakers. I've used a couple of these in the past, but I can't think of a way to get 3 audio clips to play. If I was only dealing with 2 speakers, a workaround might be to have a clip that plays audio in the right out when switch 1 is up, a clip that plays audio in the left out when switch 2 is up, and a 3rd clip that plays in both left and right outs when both switches are up. However, I can't think of a good implementation with 3 speakers, without buying at least two of the Adafruit shields.

Oh, and to further complicate things, the speakers need to be controlled wirelessly.

In summary. I have 3 switches. When a switch is on, a clip from an audio track starts playing in one of 3 wireless speakers.

Using FETs to switch between the speakers would work. I'm not sure how much losses in quality of the audio will result due to the FETs, but I think it should be acceptable provided the right FET is chosen.

The issue is not switching audio from one source between 3 different speakers. The issue is playing and pausing audio from 3 different sources, independently of the other. At least, the issue is how to do it somewhat cheaply, hopefully without requiring me to use 3 arduinos/mp3 shields.

hopefully without requiring me to use 3 arduinos/mp3 shields.

Well you can do it with one Arduino and three MP3 DF modules, not too expensive. Otherwise I can't see you doing it.