Most likely the thermocouple and firebox are picking up AC signals by capacitive coupling with the house wiring. Try electrically isolating the thermocouple from the firebox.
Or, as mentioned above, it could be a grounding issue, especially if you are collecting data using a laptop powered by house wiring. If the latter, disconnect the laptop from the house wiring and operate by battery.