Yes...
I know that the pins are different.
Yet, it turned out, I'd be able to program it without the programmer, since for a short period of time, it could be programmed.
Issue is that Arduino IDE can't see the small board.
I hate when I'm sooo dumm
You can't write to a digispark with ISP until you change the fuses with high voltage programming, because the reset pin is disabled and has been transformed into a normal I/O pin. ISP requires access to reset in order to work.
Here is an old post of mine that talks about using high voltage programming and then writing whatever bootloader you like via ISP.
The typical bootloaders are micronucleus and trinket. The only benefit of using a bootloader is you can disable reset (with a fuse setting) and get another I/O pin and yet still load new programs conveniently. Since you are armed with information about using high voltage programming, you can now choose not use a bootloader at all and set the fuses as appropriate to allow ISP programming, then disable reset to gain an I/O pin, and repeat high voltage programming in the future if you want to upload another program.