Have you used some form of interpolation between samples? On higher frequencies, it could be distorted due to truncation errors. Linear interpolation will be still OK as it's the quickest way to get rid of the noise.
Just curious, what are you trying to use the Due for? A toy piano? It sounded like you are attempting to build a synthesizer on it.