Pages: [1] 2   Go Down
Author Topic: Building an Ethernet bandwidth monitor - Suggestio  (Read 3690 times)
0 Members and 1 Guest are viewing this topic.
0
Offline Offline
Newbie
*
Karma: 0
Posts: 11
Arduino rocks
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Hi
I am thinking about building a device that I would connect on the LAN side of my Broadband router (right behind the cable modem) to constantly monitor the bandwidth used and display a graph on a display.

The TouchShield from liquidware looks like a good choice for displaying the graph.
The problem I have is how to perform the acquisition of traffic on the Ethernet connection.
It is important to understand that the device should not need an IP address and should not really communicate with any other device on the network. The Ethernet interface would act more like a probe to read packets going through the cable in a similar way as a you would do in Linux setting the interface in promiscuous mode.

Please also note that I don't want to do real packet sniffing (not enough processing power) but simply do a packet count or even better do a frame count at layer 2.
I think the real issue is to find an Ethernet device that provides traffic information instead of counting packets inside the Arduino.
Another simpler way would be to build a device that queries my router on the network using SNMP and then displays a graph but the negative side of this implementation is that it would be product-specific and I would need a router that supports SNMP.

Any suggestion is really appreciated.

Thanks
  
Logged

USA
Offline Offline
Full Member
***
Karma: 2
Posts: 213
Arduino rocks
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Yes this can be done. I recommend that you use the Arduino Ethernet Sheild (wiznet chip) or the adafruit one with the wiznet chip. Go to the wiznet web site and look at their sample code. They have samples that will let you get to layer 2 and bypass layer 3.  I have a large project that will be doing extensive use of layer 2 (i.e. implementing a protocol that is not TCP or UDP). I have looked at the sample code enough to know that it can be done.  What I am going to build will have what you are looking to do as one of the many options.

Let me know how you make out and we can help each other.

If you cant find the sample code on the wiznet site, let me know and I will go find the link again.

Mark
Logged

SF Bay Area (USA)
Offline Offline
Tesla Member
***
Karma: 135
Posts: 6782
Strongly opinionated, but not official!
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

You may also be able to monitor packet traffic using analog electronics without any ethernet controller at all.  Each packet is a burst of AC "noise" on some set of signal wires, so the total amount of traffic is (to some approximation) a measure of how much/often noise is happening on those wires...
Logged

0
Offline Offline
Faraday Member
**
Karma: 8
Posts: 2526
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Even cheap routers provide a switch, not a hub, so unless you have the ability to force the switch to mirror traffic you will only see packets addressed to your node and broadcasts; you will not see traffic addressed to other nodes.

-j

Logged

Cheltenham, England
Offline Offline
Newbie
*
Karma: 0
Posts: 21
Arduino Fiend
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

I'd find this a very useful device to connect between my ethernet gateway and the wall outlet - it could easily show (through LED-bargraph or LCD) when the connection is heavily loaded, and perhaps act as a warning device if the activity is suspiciously high for some reason.
Logged

0
Offline Offline
Newbie
*
Karma: 0
Posts: 11
Arduino rocks
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Westfw,
Interesting you mentioned this. Going analog was my original plan but then I got a digital oscilloscope connected to an Ethernet line and I couldn't really tell the amount of traffic just by looking at the wave.
I learned that 100Mbps uses a three-levels encoding -1, 0, +1 and even with no traffic the signal would still constantly change within those three values to provide clock synchronization.
http://www.erg.abdn.ac.uk/users/gorry/course/phy-pages/4b5b.html

Logged

0
Offline Offline
Newbie
*
Karma: 0
Posts: 11
Arduino rocks
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

kg4wsv,
I was simply planning to "tap" on the Tx and Rx wires that run between  the broadband router and the cable modem. kind of like you would do by connecting an oscilloscope to the line.
Logged

Cheltenham, England
Offline Offline
Newbie
*
Karma: 0
Posts: 21
Arduino Fiend
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

Just don't forget how UTP works - when one wire in each twisted pair is high, the other is low - so the same amount of current is always passing through the line. This method allows countering for noise on the line by simply examining the difference in voltage level between the paired wires.

You could theoretically tap the Tx and Rx pairs and monitor them both for wave changes, simply counting the wave changes would give a good idea of the very lowest fundamental level of traffic on the network.
Logged

0
Offline Offline
Newbie
*
Karma: 0
Posts: 11
Arduino rocks
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Mark S,
That's some good information you provided. Basically I would have to use the wiznet adapter at a MAC level (layer 2) and count the bits.
Do you know if bps data is readily available off the chip or I would have actually count the bits?
Looks like I would have to use either one of those WIZ811 or WIZ810 but I am a little afraid at the fact that these devices use SPI. How do you interface SPI with the Arduino?
Also you mentioned some sample code on their website. I looked everywhere (FAQ, Support, Q&A, forum) but I couldn't find anything. Do you happen to have a copy you can send to me?

Thanks
Logged

Copenhagen / Denmark
Offline Offline
Edison Member
*
Karma: 6
Posts: 2360
Do it !
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

I think that tapping into the RX / TX cables can easyli introduce noise that  can have a very bad influence on the quality of the line.
Logged

0
Offline Offline
Faraday Member
**
Karma: 8
Posts: 2526
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

There are some fairly strict rules about loading, capacitance, etc in UTP ethernet lines.  It would be easy to get those out of spec so that you cause yourself some network problems. If you take this approach, make sure you monitor the error count (on both sides of the connection if possible) to see if your device causes problems.

Maybe another approach would be to use the ethernet-arduino combination to pull data from the router and monitor traffic that way.  It does assume a correctly functioning router, but that's not a terribly unreasonable assumption.

Maybe your router can run dd-wrt, enable SNMP, and write some Arduino software to poll the router with SNMP.  That would be a system with a lot of other potential uses.

good luck!

-j

Logged

SF Bay Area (USA)
Offline Offline
Tesla Member
***
Karma: 135
Posts: 6782
Strongly opinionated, but not official!
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

You might also look into chips that implement only the PHY functions of the ethernet (most modern controllers integrate phy and mac in the same chip.)  That would give certainly give you analog info on packets.

In the other direction, many of the higher-end ethernet chips include extensive on-chip statistics, so you could probably read "missed packet" counts off them without ever having to actually receive any packets.
Logged

New Zealand
Offline Offline
God Member
*****
Karma: 0
Posts: 999
Arduino pebbles
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
I have a large project that will be doing extensive use of layer 2 (i.e. implementing a protocol that is not TCP or UDP).
Sounds interesting, are you at liberty to tell us more about your project? I suspect there's a lot of untapped power in the use of the Wiznet's lower-level functionality.

Quote
Looks like I would have to use either one of those WIZ811 or WIZ810 but I am a little afraid at the fact that these devices use SPI. How do you interface SPI with the Arduino?
This is not an issue. These modules use the same chip (W5100) as the official Arduino Ethernet shield so if it's wired up the same way (the SPI pins are a specific set of pins on the Arduino--only the chip select line can differ, I don't know if it's used for the shield) you can use some or all of the standard Ethernet library. The lower level functionality isn't specifically exposed though.

If you want a quick and easy way of getting started the shield is probably the best way to start. Otherwise you might want to start reading my Learning about Arduino and WIZ810MJ notes.

--Phil.
Logged

0
Offline Offline
Jr. Member
**
Karma: 0
Posts: 90
Arduino rocks
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

all of the devices you have connected to your network have LEDs indicating the traffic on the line they are connected to so just connect your Arduino to the LED and look at the duty cycle. There's your traffic and you might even have a collision detection LED which could show even more data once your traffic gets even slightly loaded.

Doug
Logged

0
Offline Offline
Newbie
*
Karma: 0
Posts: 11
Arduino rocks
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Follower,
I found your page in the past when I was looking for information on the WIZ810 but I noticed many links are broken.
In particular you have one titled "W5100 and MACRAW" which sounds interesting but is broken. (looks like wiznet redesigned their website, that's why).
Westfw made an interesting comment using some PHY chip. I've never used those before but it may be the right way to go if I just want raw throughput information. I believe pure PHY chips don't even handle MAC addresses, they simply take the electrical signal from the twisted pair and convert that to a stream of bits.
Can someone confirm this?
Also, can anyone suggest one of those PHY chip to be used for this project? It would have to be the simplest/cheapest available.

thx


Logged

Pages: [1] 2   Go Up
Jump to: