I could, but the LED might be dimly lit.
I guess what you are saying is one has to use external pull-down resistors.