That's what MorganS first suggested. I tried it without any serial commands but it made no difference...
I'm using the serial interface for the setup process of the HC-05 module. Which it is not necessarily needed for, but nice to have for troubleshooting.