A clock is required for the ISP circuitry to function, so if the chip fuses are set to use an external oscillator (or external crystal, which is not the same thing), it MUST have one before you can even set the fuses back to use the internal oscillator.