That's not a problem description... Do you get an error? Or do you get the wrong answer? And how do you know because all I see you do is an analogWrite()...
Analog read gives you a value between 0 and 1023, corresponding to a voltage between 0 and 5 (assuming VRef is 5v). If your equation assumes that Vin is a voltage, you'll need to convert it
The pow function should never be used for simple squaring, its way slower and less accurate (unless
you are lucky and the implementation is smart for integer powers).
I've tried everything but it does not work, I believe the problem is in the simulator I'm using, "https://circuits.io", I'm going to set up the circuit and test it.
I tried in Arduino, and the answer was the same as the simulator, something happens that does not allow the “Vout”, save the expression: Vout = (A+(BVin))/(1+(C Vin)+(Dpow(Vin,2))); or (A+(BVin))/(1+(C* Vin)+(DVinVin))
Instead of trying to work it all out one one line, break the equation down into sections and work them out, then combine.
That way you can check your results and find where the bugs are.