Forgot to mention, I don't expect the laptop to receive a nice smooth stream of data, I expect it to be a bit bursty and that doesn't matter, it's just status/telemetry.
The problem is that on the Arduino end, the network write call or something in the background is stalling the main loop for up to 1 second and the arduino main loop is controlling a system that needs 100hz updates.