what do you base your "what it should be" values on? I don't know the sensor you are using, but I would expect it to give higher readings when powered by 5v than when powered by 3.3v
if you are powering it through the digital pin and connecting it to a common ground and have no other connections going on... there really is nothing which should be interfering with your readings...