Analog Reading Problem

In theory you are right in practice however ... the 10 bits are +- 1~2 bits (noise, thermal influences etc)
=> Does your Arduino power supply deliver a constant 5.00V? is there noise on the line?

If you want to measure such low voltages you should set AREF to INTERNAL using 1.1V as reference

see - analogReference() - Arduino Reference -