To test whether the signal is EM pickup from the scope leads, short the scope probe tip to scope ground. Those long loopy connections with alligator clips are great antennas.
Scope probe artifacts are among the worst of beginner problems, and more are in store. Use 10X probes for most day-to-day work, and avoid long wires like the plague.