compnaion:
Is it bad for arduino?
There's a risk of taking the resistance too low (to 0, in fact), and having too large a current. I would still use an inline fixed resistor so that there's limited current even when the variable resistor is at 0.
Or at least somehow physically prevent the pot from being turned lower than a couple of hundred ohms.