Maybe it is a "weakest link" thing. The transfer will only happen at the speed of the slowest interface. You are using hardware serial, and that is limited to 115,200 bits per second. Considering 1 start bit, 8 data bits, and 1 stop bit, that is ten bits total per byte of transfer. The most you could possibly get is 11,520 characters per second transfer. 