You haven't said how you are measuring the latency - as @PaulS requested.
Without knowing that I can't test anything.
...R