Breadboards are a common source of bad connections .
When you run it horizontally is there a bigger distance to the far wall than that 3m .
There is also the problem of reflectivity and the size of the detected object . Think of the signal like a pulse of light , if the hand doesn’t reflect too well , or is at an angle to the sensor, or there are stray reflections etc ..