Strange voltage readings using my potato

Yes, that's correct. The capacitor will feed AC to the electrodes when you generate a square wave at the PWM pin.