You are correct that no Arduino is required, if the serial side of the USB converter works at TTL levels.
If it is a USB to RS232 converter, you will still need some sort of circuitry on the receiver to invert and shift the receiver RX output, before connecting it to the converter RX input.