There is no need to build your own RXTX library on the Yun: if you have an usb/serial connector and installed the correct driver (see the opkg packages) you have a /dev/ttyUSB 'file' (mind the quotes). You can open it both for reading (FileInputStream) and writing (FileOutputStream) from Java and voila.
kind regards,
Jos