I believe you would need an amplifier for the microphone but they are not expensive - the Adafruit one you linked to looks suitable.
You would also need an amplifier for the audio output. Adafruit sell stereo amplifiers with automatic gain control and so on for just a few quid.