Arduino for this? Or something else?

Yes, this is possible to do on an arduino. If you're looking for something small, you might want to look into an Arduino Nano, Micro, and/or Mini. You might also want to get one of these modules HERE

There is an enormous topic on this module in the Audio forum, here is a link

To amplify the audio signal, you can get a cheap guitar amp, and make your own cable to plug into it.