While you are moving the GPS will only be able to give your location to within about 5 meters. That's the best you can do with a normal cheap GPS.
While stationary the GPS will tell you that you are moving slowly in random directions centered on your true location. The long term average of those random movements will give your true location to within a meter or two.