Toggle LED with Switch (off same Adruino PIN)

That last circuit will not read a logic zero when the switch is not made due to the forward volts drop on the LED plus the voltage across the resistor will mean that the voltage on the input can never reach logic zero levels.

Yes it works, but you have to ensure the internal pullup is not enabled.