sandpaper isn't a good idea, it will remove the coating from the tip.
just tin the tip (melt solder on it), wipe on a wet sponge, repeat.
you can also buy special little pots of soldering iron cleaner, but I have never had a great deal of luck with them, and they are usually more expensive than a new tip.