but I'm guessing it has something to do with the additional load affecting the LM35's output.
No.
Measure the voltages on the analogue inputs and see if you can see the change with a meter.
Write a much simpler sketch that just reads the two channels and prints them out and see if you still have the same problem.
A schematic would be good. What is that blue component close to the temperature sensor.