When the button state is HIGH you are turning the LED on but then after a short delay turning it off again, hence the flicker.
When the button state is HIGH you are turning the LED on but then after a short delay turning it off again, hence the flicker.