Have you tried the loopback test to check if the usb-to-serial adapter is working? Just disconnect the Mini and short Rx and Tx on the adapter; send some data using e.g. Serial Monitor and you should get it back.
Does the voltage of the adapter match the voltage of the board (3.3V vs 5V)?