Guiding Vehicle to Point by camera

I am wanting to use a camera or other sensor to guide a vehicle to say, a red circle, automatically. I am not sure what this is called, and am having a hard time finding information on this.

Does some type of plug and play system exist for this? What is this type of control called?

Thank you for any help.

I'd call it a "guidance system", "self driving vehicle" or "self driving car".

The image processing/analysis is not simple and making it more difficult is the fact that the target becomes larger in the image as you get closer.

And of course, you need to know how basic feedback-control systems work.

Have you ever seen the [u]pigeon guided missile[/u]? :smiley: :smiley:

I think if you can do that with an Arduino there will be a great many highly-paid and highly qualified people made redundant by Google and the other companies working on driverless cars.

This is $billion territory, not plug-n-play.

...R

This is called object tracking and there is lib's in Visual Studio to do that.

I can tell more but that's my own ideas and I don't like to share them :smiley:
No offence but when you want to profit you don't share your own ideas.

D.60

The Arduino-compatible Pixy camera has internal blob-tracking software. It should do exactly what you want.

DVDdoug:
I'd call it a "guidance system", "self driving vehicle" or "self driving car".

The image processing/analysis is not simple and making it more difficult is the fact that the target becomes larger in the image as you get closer.

And of course, you need to know how basic feedback-control systems work.

Have you ever seen the [u]pigeon guided missile[/u]? :smiley: :smiley:

Never seen that! Very interesting!

Domino60:
https://www.youtube.com/watch?v=O_Fw_OsaFeI

https://www.youtube.com/watch?v=DvZPZUbnbJU

https://www.youtube.com/watch?v=X6rPdRZzgjg

This is called object tracking and there is lib's in Visual Studio to do that.

I can tell more but that's my own ideas and I don't like to share them :smiley:
No offence but when you want to profit you don't share your own ideas.

D.60

I have too many ideas, and not enough time to ever work on them all.

Here is my thinking on this:

If using a red circle as target-

Find center of red circle.

This point is converted to an angle and distance measurement from center of image.

The longer the distance, the more input to the control device.

The diameter of the red circle is also used.
Larger diameter = Object closer = more control (turn wheels more, etc)

But, I am no coder. Does this seem about right? Fairly easy to code or not?

I have used openCv to track a blue square. I remember it working?..

Its probably better now, was a few years ago.

Anyway , worth a look, Needs more processing power than an arduino though.

jremington:
The Arduino-compatible Pixy camera has internal blob-tracking software. It should do exactly what you want.

Looks great! But the camera on the board might be an issue. I guess it wouldn't be too hard to change that though.

I guess it wouldn't be too hard to change that though.

It would be impossible, and why would you want to do it?

The Pixy's primary function is to do this:

guide a vehicle to say, a red circle, automatically.

Pixy cam looks good i done a research and looked few videos one problem is that if you put
more same color objects and use the camera as tracking the cam will be confused and will
randomly chose one object or the object with the more pixels, as well if you got a background
color it will be picked by the camera and affect the tracking if you got more colors imported.

I'm not saying it's bad, it's really nice cam but for this topic just tracking a single color/ball
will do the job.

one problem is that if you put more same color objects and use the camera as tracking the cam will be confused

No, it won't be confused.

The camera gives you a list of all the objects it is properly trained to track, their color and position.

You may be confused by that list.

No, it won't be confused.

I can give you a video where a guy use same color objects and camera can't decide which one
to track

Domino60:
I can give you a video where a guy use same color objects and camera can't decide which one
to track

The camera isn't doing the tracking.

The guy wrote a program that was confused by the list of objects supplied by the camera.

An unfortunate, public display of weak programming skills.

The camera isn't doing the tracking.

The guy wrote a program that was confused by the list of objects supplied by the camera.

An unfortunate, public display of weak programming skills.

yes that's true, i totally forgot about that so im sry, at this point i can't tell more because
i don't know the lib/code pixy is using.