I was having the same problem but now seems to be solved.
The parallel 10kohm connection doesnt work in many cases, and the analog pins still fluctuate when the signal is off. This can be bad when you need not only a 1 but also a steady 0.
Heres what I did:
If you are using a breadboard, connect the two main ground lines of the bread board(blue lines) together. (one of them is connected to your arduino ground, right?)
Then, hook up the "other" ground line to the "second" ground port of your (hopefully new) arduino. This way your "analog in" will remain steady at NOT zero, but at a constant value..which you can at least convert to a "zero" in your program.
But theres a soltn to that too...use the digital in of Arduino and you should get a 0 and 1 with no more fluctuations, provided you are running your breadboard the way I described above.
Hope this helps you. :D