Adding a 4.7k pull up resistor seems to have done the trick.
However now the readings seem to be quite unreliable, the sensor sometimes reads what seems to be accurate other times it starts saying that its above 60 C and below 15 C in the next second. Any idea what is causing the flipping behavior?