In theory you are right in practice however ... the 10 bits are +- 1~2 bits (noise, thermal influences etc)
=> Does your Arduino power supply deliver a constant 5.00V? is there noise on the line?
If you want to measure such low voltages you should set AREF to INTERNAL using 1.1V as reference