Arduino MIDI Looper !

For recording onto SD card see Arduino Uno - How to store data for voice recording into SD ? - Project Guidance - Arduino Forum

Recording onto external SRAM is possible. My book shows you how, but with a single chip you can only get about 10 seconds or so depending on your same rate.

also see Google Code Archive - Long-term storage for Google Code Project Hosting.