USB Serial on Leonardo is affecting a sketch

I do not think so it takes a bit over 10ms to get about 20 bytes at 19200
the device is required to respond to poll within a 20ms time frame
which it does on every poll.
the 1 ms delay I used are for inter byte delay prevent reading a byte before it is there. so a 20 byte read takes 40-50ms

After 20ms I am allowed to poll another device if I had one connected.