Any ideas how to fix this?
Sure. Use Serial.write() instead. What's so hard to understand about that?