In the end some stray service enabled the ttyACMx devices to be as write only with grout tty. By disabling them fixed the issue. On Ubuntu 16.04 I dit it via theese commands:
$ sudo systemctl stop serial-getty@ttyACM0
$ sudo systemctl disable serial-getty@ttyACM0