Pages: [1]   Go Down
Author Topic: Web scraping with Ethercard (enc28j60) example  (Read 1099 times)
0 Members and 1 Guest are viewing this topic.
Melbourne Australia
Offline Offline
Newbie
*
Karma: 0
Posts: 11
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

Hi,

In case anyone is interested, I've written a web scraping example using the Ethercard library, (for enc28J60 based modules)

Ethercard has recently been updated to be able to retrieve a whole web pages, in 512byte (packet size) chunks.

I've written written some functions to search for a specific marker string within the web page, which are designed to work across packets to find the target text on a normal web page.

I've posted an example which retrieves my current weather conditions for Melbourne Australia

Full details are on by blog at http://www.rogerclark.net/?p=499

I'm keen to improve the code, so if it doesn't work for specific web pages, please feel free to leave a comment on the blog and I'll take a look at the problem

Cheers

Roger Clark
Freelance web and iPhone app developer / Producer. Melbourne Australia. www.rogerclark.net
« Last Edit: November 22, 2012, 05:01:10 am by Roger Clark » Logged

Freelance web and iPhone app developer and Producer. Melbourne Australia

Belgium
Offline Offline
Full Member
***
Karma: 0
Posts: 144
Just Do it (with Arduino of course)
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Nice. Do you think it can coexist with some Cosm client application ?
Logged

Pages: [1]   Go Up
Jump to: