Teensy 3.1 is a Arduino "like" system that can do all that with libraries that are already written. It runs at 96MHz and has audio functions that use the DSP of the chip. It can do stereo high quality audio. It is also significantly smaller than my thumb.
Edit:
There is also an audio board for it that includes SSD (small flash card) that is fully integrated into the libraries.