I've made a dual-layer version of the circuit 
Unfortunately it's very late again and I haven't had time to properly verify it. Maybe tomorrow...
Front:
Back - Mirrored:
Back:
The ground plane really has helped a lot. The board size has decreased from 180 x 120 mm to 140 x 100 mm Thanks for the tip, CrossRoads!