I have worked with an UNO at 500K - which is 1/32 of the clock - where 460800 is 1/34.7222 so not a nice divider of the clock. This causes errors.
So I don't know the speed of the DUE but by taking a integer divider you should be able to get higher than the standard speed, with reasonable reliability.