leap motion controlled robotic arm with Processing and Arduino

[system]

Hi all

I have been experimenting with leap motion and robotic arm. The idea is to control the robotic arm with my arm!

I have managed to make a crude version. The video can be found here:

Leap motion controlled robotic arm

Generally it works ok. The main problem I am facing now is the control of fingers when my hand rolls to 90degree. This is when the two fingers are overlapping vertically and leap motion can only detect 1 of them!

Any advice to solving is problem is welcome! Any comment is appreciated too!

Update: the hardware setup

[drewdavis]

That is amazing! I have that same robot arm and I'm trying to figure out how to control it better. Right now I just set the servos to go to a certain point. What do you do?