Have you tried just connecting the motor direct to 1.5V e.g. an AA cell? Then you might get a better idea of what its "full potential" on 1.5V really is. From my (modelling) experience of small brushed motors if you want them going fast you nearly always run them on more than their nominal voltage.
Steve