Arduino pin always HIGH

I don't have a multimeter, so can't test with it, I'm only testing with a led to GND.

I would strongly recommend you do obtain a multimeter immediately, it's an essential tool for working with arduino projects and will help immensely with learning the basic electronics one needs to be successful with their arduino projects. They can be had very inexpensively and it will return great dividends for you.

Lefty