Disabled gamer desperate for help with custom PC modular controller

Other Hardware Device Hacking
1

Hello,
I hope this is the right place to post this. Sorry if it isn't :blush:

My name is Matt and I'm a disabled gamer that is now unable to operate conventional controls such as Mouse and keyboard, or conventional game controllers. I've searched far and wide for a solution and unfortunately I am unable to use any product out there that already exists. I am desperately looking for someone to help build me A customer modular controller device that I can use easily. I believe that an arduino microcontroller can easily achieve this with the expertise of someone who understands this stuff, because I don't.

I am being provided an eye-tracking device that will allow me to control the mouse, but the keyboard function of the device is extremely awkward at best and does not allow for simultaneous control, and I have an extremely difficult time reaching my keyboard. As you probably know, simultaneous access to the keyboard and mouse is pretty crucial to play most games. I would like to be able to move via thumbstick while using the eye-tracking device to aim

I need A set up where I can control a small thumbstick with my a fingertip or knuckle, and two individual buttons that I can tape/velcro to my index finger so I can easily and quickly press them with my thumb. Anything further than that can probably easily be controlled with voice command software.

I attached some rough sketches I created in Photoshop:

I was thinking about using this as the thumbstick:
PSP 2-Axis Analog Thumb Joystick : ID 444 : $3.50 : Adafruit Industries, Unique & fun DIY electronics and kits (it's a replacement PSP thumbstick)

Would it be possible to use these lights pressure switches as the buttons? They are designed to plug into a switch interface via 3.5 mm mono Jack...
http://www.marblesoft.com/store/index.php?route=product/product&path=27_72&product_id=129

configuration.jpg
configuration.jpg640×648 23.6 KB

control-hand.jpg
control-hand.jpg640×648 20.7 KB

2

I believe you want one of the newer Arduino or compatible controllers that can generate USB mouse and keyboard events. I've not used the capability, but the Leonardo, and Due support it as official Arduino boards. In terms of compatibles, the PJRC Teensy 2.0/2.0++/3.0/3.1, the Adafruit Flora/Trinket/Gemma, and the Digistump Digispark/DigiX also support the USB keyboard and mouse. The Arduino Uno does not support it without using a USB host shield. I don't recall if the Mega supports it.

You can get breadboard adapters for 3.5mm connections to hook up the switches. For example, this board from Sparkfun: SparkFun TRRS 3.5mm Jack Breakout - BOB-11570 - SparkFun Electronics. You can also get the ends you solder wires to for a panel mount 3.5mm at places like Radio Shack (if you live in the USA).

One thing that might be an option is touch sensing. The Teensy 3.0/3.1 have certain pins that can do touch sensing and return an analog value based on how close your fingers are to a wire connected to the appropriate touch pin. You don't have to make contact at all (obviously, it will take some time to figure out how close to get and what values returned mean what). Unfortunately there isn't a whole lot of documentation for it. There is this thread for instance: Teensy 3.0 capactive touch. I don't think any of the other Arduino or compatibles can do this directly. There are ways to do it on the other platforms, using two pins.

I recall that there was a post within the last month or two, of somebody who was making an interface for his disabled friend in this forum. You might try searching for it. I tried some simpled minded searches, but I wasn't able to find it. If you find it, you might see some ideas to try.

Good luck!