after a reset its normal to have a few seconds waiting time but if you don't reset it manually (press the resetbutton, upload software or power it of and on) it shouldn't happen ... hmm, what led? the onboard one on pin 13? if you use another led it can be a simple connection problem or you made a mistake with your programming (randomnumbers or something like that)