you need a 220 Ohm to 470 Ohm resistor between the Arduino output and the LED. Without it you will damage the Arduino outputs.
What you might be seeing is the turning on and off of the 1 bit as you count up. Every other number is ODD so the 1 bit would be lit for every other number.
Don't have my Arduino here at work so I can't test the code.