How to make a face tracking fan

Hello, I am a freshman in mechanical engineering, and this semester we've been learning how to use an Arduino.

Currently, our group is working on a project.
Our idea is a fan that is on an arm. The arm is connected to the wall using a suction cup. That arm has a motion - It moves on the x-axis. Something similar to this -

So it has a servo motor that spins, and so does the fan on top of it. But instead of being attached to a box, it is attached to an arm that you stick on a wall. We might also add another servo motor on the end of the arm (near the wall), so that it would spin on the y-axis.

My main concern right now is face detection. I am pretty sure an Arduino does not have the capabilities to process that much work. I've been researching today and found a couple of things that could help us.

1 - ESP32-CAM - a microcontroller that has AI features for face detection. The ESP32-CAM sees a face at (x, y) in the frame. It calculates whether the face is left/right or up/down from the center. Then it sends signals to servo motors that move the fan base left or right (and maybe up/down if we add another servo).

2 - MU Vision Sensor
The MU Vision Sensor detects a face and finds its position. It sends coordinates (X, Y) to the Arduino. Moves servos left/right to follow the face.

3 - Gravity: HuskyLens K210 AI Camera
HuskyLens detects a face and reports the bounding-box center (X, Y). Arduino reads that X and Y coordinates Microcontroller maps X and Y → servo angle and drives one (pan) or two (pan+tilt) servos so the fan physically rotates to face the detected X and Y.

What other things could you recommend?
Anything we should be aware of?
What would be the hardest parts of this project?

The parts that you have the most trouble understanding, designing and building.

Do you have mechanical engineering skills for the arm design and construction? Some knowledge of the Inverse Kinematics required for positioning the fan?

Currently, our group is working on a project.

What will the other group members contribute?

1 Like

AFAIK the face detection feature of the esp32-cam has been discontinued due to lack of processing power BUT it's big brother the XIAO esp32-S3-Sense has lots.

  1. We don't have much knowledge of kinematics. I took A Level Physics in high school and got an A* haha. (Which is like AP Physics with an A+) But that's really it. But hopefully, as we do the project, we learn and fix our mistakes.
  2. It's 4 of us in a group. Me and one other guy mainly do the research and parts required for this, while the other 2 build more. Of course all of us will work on the projects the equal amount. It's just my trait to try to find similar solutions online :slight_smile:

Okay, thank you so much for this information!

Did you consider a grid-eye (AMG8833).
Leo..

By now, some one of your group must have tested this. At least the suction cup on the wall. Picture,please.