How to attach a potentiometer to a servo motor shaft

The normal way of measuring weight (what is often called "mass" though they're not the same thing) with a scale is by measuring force: the force at which the earth's gravity pulls at the object.

So attaching a spring scale to your handle and pulling it is basically the same thing.