Pages: [1]   Go Down
Author Topic: Controlling a computer (internet browser) with Arduino  (Read 1519 times)
0 Members and 1 Guest are viewing this topic.
Offline Offline
Newbie
*
Karma: 0
Posts: 14
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Hey there everyone, I am starting my second project that is going to be a speech recognition "robot". For those of you familiar with the Ironman movies, Jarvis inspired this project. Anyway, I am wondering if it is possible to write code that, based on a specific input, can access the internet, my Arduino will be plugged in via USB, and I would like to have it open my web browser, does anyone know how to go about this? I would like to do it without an ethernet shield, but maybe i'll have to. I remember specifically seeing an Instructable that had an IR and a guy programmed his Arduino to receive the input from a remote and it opened up Youtube, but sadly I cannot find that 'ible.
Logged

Maine
Offline Offline
Sr. Member
****
Karma: 14
Posts: 417
Caution: Explosives in use.
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

Something like Gobetwino would be an easy way to accomplish this, I think:
http://mikmo.dk/gobetwino.html

Other than that, you would have to write some software that would run on the PC and listen for the arduino to talk to it over serial.
Logged

"Anyone who isn't confused really doesn't understand the situation."

Electronic props for Airsoft, paintball, and laser tag -> www.nightscapetech.com

Global Moderator
Netherlands
Offline Offline
Shannon Member
*****
Karma: 212
Posts: 13531
In theory there is no difference between theory and practice, however in practice there are many...
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset


You might let the Arduino behave like a keyboard (google +USB +HID +Arduino +Keyboard) as almost all functions can be keyboard controlled.

Gobetwino +1 
Logged

Rob Tillaart

Nederlandse sectie - http://arduino.cc/forum/index.php/board,77.0.html -
(Please do not PM for private consultancy)

0
Offline Offline
God Member
*****
Karma: 39
Posts: 988
Get Bitlash: http://bitlash.net
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Bitlash Commander could do what you want, with Bitlash on the Arduino:



    https://github.com/billroy/bitlash-commander
    https://github.com/billroy/bitlash

Commander is a little web server app that runs on your pc and talks to Arduino over the USB serial port.  You make web pages with control panels that talk to the Arduino using Bitlash to control it.  There's a little graphical editor or, if you know html and javascript, it's easy to use the control library to design your own pages.

The Arduino can send update messages targetted to a specific control.  You could make the control open another web page when a certain value arrives, with a little javascript.

-br
http://bitlash.net

Edit: fixed image url.
Logged

Offline Offline
Newbie
*
Karma: 0
Posts: 14
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Those are some great ideas, i'm pretty sure that they both are capable of doing what I am asking. After much search last night, i found  http://www.instructables.com/id/Teensy-IR-PC-Remote-Keyboard-Mouse-Youtube-pla/?ALLSTEPS (the Instructable that had this feature) it was with a Teensy, but still, it's impressive.

Are these ideas posted just for internet access? or could I access programs, files, ect?
Logged

UK
Offline Offline
Shannon Member
****
Karma: 223
Posts: 12577
-
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Your PC will do voice recognition far better than any Arduino. Why not just do all this directly on the PC?
Logged

I only provide help via the forum - please do not contact me for private consultancy.

Offline Offline
Newbie
*
Karma: 0
Posts: 14
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

I think the main reason is because I want to control outlets, lights, ect. And i'm not sure how to do that with a PC, but I do know how I would with an Arduino. I'm sure you are very right about the PC doing a better job than the Arduino, but I am using a PC program to do the speech recognition (BitVoicer) and then it returns a serial value. It is made for microcontrollers. If there is a better way of doing this i'd love to know.
Logged

Copenhagen / Denmark
Offline Offline
Edison Member
*
Karma: 6
Posts: 2360
Do it !
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

If you do the voice recognition on the PC and the voice recognition software can send data over serial to Arduino then that's fine, but you still have the problem with controlling the browser. If your voice recognition software can't do that you have a problem.

The serial port can only be used by one program at a time, so if the voice recognition software is using the port GoBetwino or anythig else can't use it.

So baiscally you need ONE piece of software on the PC side that can do all the things you need that involves serial communication with Arduino.
Logged

Offline Offline
Newbie
*
Karma: 0
Posts: 14
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Oh that makes sense. Well how about the mouse and keyboard libraries? Would there be any way to access a browser through them, let's say after the serial data was sent from the voice recognition software to the Arduino?
Logged

0
Offline Offline
Tesla Member
***
Karma: 141
Posts: 9470
Arduino rocks
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
I would like to have it open my web browser

What function is the web browser to play? You probably can open your default browser just with a batch file. Copy the below, paste in notepad, and save as test.bat on your desk top. Then double click the test.bat to see if your browser opens.

Code:
start http://Golden-Triangle.com
« Last Edit: December 26, 2012, 12:54:09 pm by zoomkat » Logged

Consider the daffodil. And while you're doing that, I'll be over here, looking through your stuff.   smiley-cool

Offline Offline
Newbie
*
Karma: 0
Posts: 14
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

wow, that was really easy/awesome. I'm not familiar with batch files or how to implement them into an Arduino project.
Logged

Seattle, WA USA
Offline Offline
Brattain Member
*****
Karma: 601
Posts: 48556
Seattle, WA USA
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
I'm not familiar with batch files or how to implement them into an Arduino project.
Because you can't. The idea is that YOU write an app on the PC that monitors the serial port, and executes various existing applications on the PC (using system() or some variation of that) to perform the tasks you want.

The "existing applications" may not be easy for system() to start, but batch files are, and generally a batch file can be developed to start any application with any arguments.

You could also, depending on the language you develop your application is, embed a browser in your app.
Logged

UK
Offline Offline
Shannon Member
****
Karma: 223
Posts: 12577
-
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

I think the main reason is because I want to control outlets, lights, ect. And i'm not sure how to do that with a PC, but I do know how I would with an Arduino. I'm sure you are very right about the PC doing a better job than the Arduino, but I am using a PC program to do the speech recognition (BitVoicer) and then it returns a serial value. It is made for microcontrollers. If there is a better way of doing this i'd love to know.

It seems that you're already planning to do the voice recognition on the PC, and that seems by far the most sensible option. I don't know what form of output your voice recognition software provides, but I'm sure you could find freeware to output in pretty much any way you want.

For the actions that involve interacting with hardware, it would be sensible to implement those on an Arduino and have them triggered and controlled by an application on the PC. For actions that involve interacting with things on the PC (such as opening browsers) there would be no need to involve the Arduino at all.

Basically, it seems to me that you will need an application on the PC that receives commands from your voice recognition software and either executes a command on the PC or sends a command over the Arduino's serial port to switch hardware on and off.

There is a huge variety of options for ways to implement the PC side. You could do it in Processing, or write an application in 'C', C++, C#, Java, VB or whatever other language takes your fancy. It's possible you could even find voice recognition software which includes the capability to launch local utilities and write to a serial port, in which case you may not need to write anything at all on the PC.
Logged

I only provide help via the forum - please do not contact me for private consultancy.

Pages: [1]   Go Up
Jump to: