I would try the loop back test to narrow down the problem.
It might be a bit tricky on your custom board. You can test both M8RXD/M8TXD and IO0/IO1. Which brings me to double checking the soldering for RN4A and RN4B and other pins involved in the path.