LM4040 AREF Pin Voltage Drop

You can't run a 5.0V reference from 5V+/-5% !!!!
You need definite headroom.
Also you can't risk having VREF > Vcc, that's never going to work. With 5V logic a 4.096V reference is the obvious choice.

Or 4.5V, like the REF5045