How to program a robot that can be told what object to manipulate

Hey community! This is my first time using Arduino and I am building a robot that has environment recognition and voice recognition. With these things in mind, I plan to program the robot to pick up a certain object with a voice recognition feature. I am using a Nicla Vision Pro camera and Gobilda speed servos. I am using an Arduino mega r3 2560 board. How do I approach this situation? Please help this is for a science fair project and it's due January this month.

Hi @robolearner welcome to this forum.

Unfortunately this is a very difficult project, if not an impossible one, for an experienced programmer let alone one for a beginner. There is no way I can see you getting this to work on your time scale.
Sorry.

3 Likes

Hello, @Grumpy_Mike is there by chance any voice recognition product here on Arduino that might fit my needs? Or environment recognition products? Considering you only talked about the programming side of things.

There are two types of voice recognition module you can buy, one that you have to train for your voice and those that you don't. The former is the more accurate type but it is still not very good. A google search will show you a few options.

That is the difficult, if not impossible, bit of your project. You can get modules that you can train to recognise simple things like colored balls, because they are shape invariant from what ever angle you see them. But actual objects can be seen from all angles so getting even one object to be recognised is the sort of project you might do for an MSc, post graduate submission.

I was thinking about using an ultrasonic sensor just for this specific project because the reason why I chose it was for it to be aware not to hit anything. Therefore, using an ultrasonic sensor it can recorrect itself by not crashing into something.

For the part that has to manipulate an object can I code the Nicla vision pro camera to recognize three certain objects? The point of this part is for it to choose a certain item of my choosing. Of course, these items will be in front of the robot but how would I approach this?

What are these objects?
Any way I doubt that you can do this, for the reasons I have said before.

I made a 6-DOF arm with servos and the Nicla camera is the "head" of the arm. Considering this what method of recognition should I use (QR code, color, or shape?)

The simplest is colour.

Is an Arduino Mega 2560 simple enough to support the amount of code or is there anything in Arduino needed in addition to power up this board?

The Nicla Vision camera is not compatible with the Arduino Mega 2560. From the product page:

The PIXY (CMUCam 5) is compatible, though.

User Arduino to control the servos. Use an OrangePi/RaspberryPi for the rest.

If you already had university doctorates in robotics, machine learning, machine audio & image recognition, you might be able to do this in a year. You would also know that an Arduino mega would only be capable of playing a small part in the project.

Choose something more reasonable to present at your science fair. Your expectations are hopelessly high.

This topic was automatically closed 180 days after the last reply. New replies are no longer allowed.