Problems with high RPM with NEMA-17 Stepper Motor

Even if your belt is rubber covered fiberglass it will stretch over time and temperature. That picture shows you have VERY LITTLE pulley surface in contact with the belt. A tension pulley would allow you to have at least a 3/4 wrap of the belt.