Planning to use a pot as a variable resistor on Arduino

Other than that I have no use for resistor, thus I don't want to bother with getting one.

If you can't be bothered getting a $0.01 resistor then I suggest that this hobby is not for you.

I will use the middle pin and right pin of the pot in other words). Is it bad for arduino?

The biggest danger is to the pot. Using a very small section of the track will burn out the pot.