Ok, I retried measuring the voltage across the analogue pin while looking at the serial monitor, and as long as I'm measuring the voltage across it, the readings in the serial monitor are correct, but as soon as I remove the multimeter probe from it, it goes back up to 1023.
Does that mean that my Arduino doesn't work?