LM4040 AREF Pin Voltage Drop

If... OP wants to measure absolute voltages in that range, then an ADS1115 (with internal 1.xxvolt reference and 4.096 volt PGA) could be a much better choice.
Let's wait until we know what needs to be measured.

Headroom for the LM4040 could be as low as 4.65 (Nano on USB supply) - 4.096 = 0.55volt.
Leo..