Airsoft solenoid controller

Ok so this is what i have. simple led and a button.

const int buttonPin = 3;
const int ledPin = 2;

int buttonState = 0;

void setup() {

pinMode(ledPin, OUTPUT);
pinMode(buttonPin, INPUT);
}

void loop() {

buttonState = digitalRead(buttonPin);

if (buttonState == HIGH) {
// turn LED on:
digitalWrite(ledPin, HIGH);
delay (100);
// turn LED off:
digitalWrite(ledPin, LOW);
}
}

Led dosent turn off with the button held. that what im trying to make happen. Forgive my crappyness.