Yet another simpler idea like yours is maybe this. It will probably fit into a shield footprint with the few additional components needed like speaker, switches to select serial port pins (hardware/software) and a couple of jumpers to optionally break out signals like RING, CTS.