Want to remove 32.768 kHz oscillator

To reduce the components amount I don't want to put the 32.768 kHz oscillator on my own Due. Can I leave the corresponding XTAL inputs unconnected?

Will I face to any issues if I don't use the low freq. oscillator?