Could you post the sections of code you use to set up and trigger the DMA? I have ideas but I don't want to make a load of suggestions you have probably already tried. I'd experiment with priorities to try and get the DMA above the Cortex read/write, and also experiment with locking options.