For an opamp you would need an inverting circuit where you replace the virtual ground at the (+) input with a reference (pot) to remove the offset. The gain should be 5 but you could make it adjustable, too. Some other factors to consider are the power supply, most op amps do not like 5V single supply power, so you need probably one of those fancy cmos ones. Then there is the output swing, that depends on your choice of power supply and op amp. You want to make sure it can swing to zero and it can reach 5V.
Another option would be to use a higher power supply for the potentiometer and use some diodes (or a zener diode) to remove the offset. The higher supply would act as an amplifier. But that could break the arduino if it gets in the analog pin, so this also presents problems.