here's a small excerpt of the data. In its repetitiveness of the smae values over and over it is very representative of the whole dataset.

Repeating output values are probably caused by the fact that you are reaching the limits of the accuracy.

Test:

Copy the numbers to a speadsheet in colum A

Sort that colum from low - high

Make colum B : "=A2-A1" extended for the whole colum A

There will appear 2 distinct values : 0 and 0,0144 (+- 0,0001)

which means the resolution the (current) algorithm produces is 0,0144, so printing with more than 2 decimals makes no sense

If you want more decimals you need to do a numerical analysis of the algorithm (and hardware sample freq/timinig/adc precision etc)).

Hope this helps,