True. It would be especially crude if you weren't using a modem IC. Since you aren't using the transmit portion of the IC, anyway, might as well make use of it to encode the audio as well.
However, in discussing the discrete version using PLL ICs for example, you would only need to built the receiver portion. So, it would be better to use a program on the computer to encode an audio file.