The MedianFilterInt example that comes with the library makes me think the declaration should be more like:
volatile MedianFilter<uint32_t> medianFilter(5); // 5 samples
If any of the spurious values get through the filter, increase the number of samples.