Do you see the same problems at a really slow baud rate like 9600?
If you send fast enough to get ahead of the arduino's read/draw loop by more than the size of the serial buffer on the arduino there will be lost characters, right?
You may have to transmit that big packet in smaller chunks to avoid the pig-in-the-anaconda effect.
-br