Not sure if this helps, but I ran 2 tests to see how bad the error is. It is much worse than I said before, but it also has a weird shape. 
I have no clue why it would do this ramping thing, I cannot find any info about it in Java, and I did not make it do that. It somehow recovers
It also stays low after that peak. I made it do another 64 after the first without closing the connection, and the highest it went was 6