Line following general question

Then you are not doing it right. Why should the torque be halved?
What are you using as a driver?
Can you post a schematic?