How fast can you blink an LED (Theoretical fastest speed)

As others have indicated, 1 ms is slow in Arduino land.

However if you want to power and LED that requires a driver you have to pay attention to the Arduino output drive limitations. But you can still approach 100's of ns with a larger LED.