If you're gathering data on your Yun and want to store/display it as graphs/charts/etc. you can use the Plotly web site ( https://plot.ly/ ). Plotly seems to be free and they have a python api that you can call from the linux side on the Yun to upload data that in my case is stored on the SD card.
To get the python API to work I needed to get a couple of openssl packages for python: opkg install pyopenssl opkg install python-openssl
and get the Plotly python api code from thier web site.
Then the python (I'm not a python person) is pretty straight forward. Parse the data file and pass it to the plotly web api:
import plotly
from array import *
data_filename = "../datalog.txt"; #SD Card data
N_POINTS = 300
file = open(data_filename, 'r')
nLines = 0
nShortLines = 0
maxLines = 10
count = 1
ticks = list()
temps = list()
humids = list()
dewys = list()
for line in file:
if (len(line) > 1):
nLines = nLines + 1
words = line.split(' ')
if (len(words) == 2):
fields = words[1].split(',')
time = fields[0].strip()
temp = fields[1].strip()
humid = fields[2].strip()
dewy = fields[3].strip()
ticks.append(count)
temps.append(float(temp))
humids.append(float(humid))
dewys.append(float(dewy))
count = count + 1
print("Time: {} Temp: {} Humid: {} DewPt: {}".format(time, temp, humid, dewy));
else:
nShortLines = nShortLines + 1
if (nLines > N_POINTS):
break
y = plotly.plotly( USER, APP_KEY) # this is YOUR account information from plotly
response = py.plot(ticks, temps, ticks, humids, ticks, dewys, filename='Arduino Yun Data')
url = response['url']
filename_resp = response['filename']
DrSpeed:
Plotly seems to be free and they have a python api that you can call from the linux side on the Yun to upload data that in my case is stored on the SD card.
Yeah, I'm also very interested in this! Please give us some more details. For example:
Can you upload your sketch? How did you log the data in the txt?
And to run the Python File: Did you just include a runShellCommand(...) to run the python file?
I couldn't figure out how your lines in your log.txt look like can you upload that file also?
EDIT:
Ok, I figured out a little by myself and will give some more detailed info for beginners
As was already written: Install OpenSSL etc. via SSH (How to enter SSH: open a "Terminal" window on MacOsX and enter "ssh root@XXX.XXX.XXX.XX" (XXX.... shall be the currrent iP of your Yun in the network)). After you entered your root passwort and are now in the SSH-Command-Line enter this:
opkg update
opkg install pyopenssl
opkg install python-openssl
What we all need is to get "distribute", "easy_install" and "pip" via SSH-Commands (so we can install plotly over ssh on the linino):
opkg update
opkg install distribute #it contains the easy_install command line tool (this can take some time)
opkg install python-openssl #adds ssl support to python
easy_install pip #installs pip (this can take some time)
Now install plotly via SSH-Command:
pip install plotly (this can take some time)
After that you can create a sketch that makes a datalog.txt on your SD-Card (see e.g. DataLogger-Tutorial @arduino.cc)
Now create the .py-file with the code Dr Speed posted *** (use e.g. TextWrangler for this), BUT change the path to your datalog.txt for example and all the plotly-Credentials (name, key).... Then: import that .py-file on your Yun (e.g. with an SFTP-Client like Cyberduck or just put it on the SD-Card with your computer), after that enter in SSH:
python /mnt/sd/Filename.py
This should run the transfer (of the datalog.txt) to plotly and you can see your graph on their website.
*** = BE CAREFUL: The code posted by Dr_speed has some little mistakes (copy-paste-related I guess). The variable "y" somewhere at the bottom: needs to be "py" instead of "y". And somehow python/yun wouldn't accept e.g. the line "temps.append(float(temp))" because it can't convert the String to a float... So I temporarily just put a float inside it: temps.append(1.99)
Ok, I made something similar with a dht21, bmp085, RTC module, temboo and google drive... (for free)
But I really want to test your way beacause mine take 80% of memory on the Yùn :~
And I still have to add 8 relays driven by temperature and time and the tracking on gsheet... Not sure if i'll have enough space on Yùn...
I have installed the dependencies and plotly everything is ok so far. Right know, I'm starting to modify the datalogger code for a dht21 and a bmp085 because apparently your way don't need a RTC module...
Then, the py file... Hoping commands for nano in Yùn are the same on Raspberry Pi otherwise it'll be hard...
#define DHTPIN 4 #define DHTTYPE DHT22
const String GOOGLE_USERNAME = "xxxxxxxxxxx";
const String GOOGLE_PASSWORD = "xxxxxxxxxx";
const String SPREADSHEET_TITLE = "ArduinoYun";
const unsigned long RUN_INTERVAL_MILLIS = 3600000; // how often to run the Choreo (in milliseconds)
unsigned long lastRun = (unsigned long)-60000;
Adafruit_BMP085 bmp;
DHT dht(DHTPIN, DHTTYPE);
RTC_DS1307 RTC;
void setup() {
Serial.begin(9600);
Bridge.begin();
Console.begin();
bmp.begin();
dht.begin();
RTC.begin();
if (! RTC.isrunning()) {
Console.println("RTC ERREUR !!!");// la ligne suivante définit l'heure du RTC à celle ou le code a été compilé
RTC.adjust(DateTime(DATE, TIME));
}
}
void loop()
{
// get the number of milliseconds this sketch has been running
unsigned long now2 = millis();
// run again if it's been 60 seconds since we last ran
if (now2 - lastRun >= RUN_INTERVAL_MILLIS) {
// remember 'now' as the last time we ran the choreo
lastRun = now2;
DateTime now = RTC.now();
Console.println("Getting sensor value...");
// get the value we want to append to our spreadsheet
int date = (now.year());
int heure = (now.hour());
unsigned long Pression = bmp.readPressure();
int TBMP = bmp.readTemperature();
int TDHT21 = dht.readTemperature();
int Humidite = dht.readHumidity();
Serial.println("Appending value to spreadsheet...");
// we need a Process object to send a Choreo request to Temboo
TembooChoreo AppendRowChoreo;
// invoke the Temboo client
// NOTE that the client must be reinvoked and repopulated with
// appropriate arguments each time its run() method is called.
AppendRowChoreo.begin();
// set Temboo account credentials
AppendRowChoreo.setAccountName(TEMBOO_ACCOUNT);
AppendRowChoreo.setAppKeyName(TEMBOO_APP_KEY_NAME);
AppendRowChoreo.setAppKey(TEMBOO_APP_KEY);
// identify the Temboo Library choreo to run (Google > Spreadsheets > AppendRow)
AppendRowChoreo.setChoreo("/Library/Google/Spreadsheets/AppendRow");
// run the Choreo and wait for the results
// The return code (returnCode) will indicate success or failure
unsigned int returnCode = AppendRowChoreo.run();
// return code of zero (0) means success
if (returnCode == 0) {
Serial.println("Success! Appended " + rowData);
Serial.println("");
} else {
// return code of anything other than zero means failure
// read and display any error messages
while (AppendRowChoreo.available()) {
char c = AppendRowChoreo.read();
Serial.print(c);
}
}
while(!Console); // wait for Serial port to connect.
Console.println("Filesystem datalogger\n");
}
void loop () {
unsigned long Pression = bmp.readPressure();
int TBMP = bmp.readTemperature();
int TDHT21 = dht.readTemperature();
int Humidite = dht.readHumidity();
// make a string that start with a timestamp for assembling the data to log:
String dataString;
dataString += getTimeStamp();
dataString += ",";
dataString += Pression;
dataString += ",";
dataString += TBMP;
dataString += ",";
dataString += TDHT21;
dataString += ",";
dataString += Humidite;
dataString += ";";
// open the file. note that only one file can be open at a time,
// so you have to close this one before opening another.
// The FileSystem card is mounted at the following "/mnt/FileSystema1"
File dataFile = FileSystem.open("/mnt/sd/datalog.txt", FILE_APPEND);
// if the file is available, write to it:
if (dataFile) {
dataFile.println(dataString);
dataFile.close();
// print to the serial port too:
Console.println(dataString);
}
// if the file isn't open, pop up an error:
else {
Console.println("error opening datalog.txt");
}
delay(5000);
}
// This function return a string with the time stamp
String getTimeStamp() {
String result;
Process time;
// date is a command line utility to get the date and the time
// in different formats depending on the additional parameter
time.begin("date");
time.addParameter("+%D/%T"); // parameters: D for the complete date mm/dd/yy
// T for the time hh:mm:ss
time.run(); // run the command
// read the output of the command
while(time.available()>0) {
char c = time.read();
if(c != '\n')
result += c;
}
return result;
}
And the python code without errors. Don't forget to install dependencies as describe before
I'm also posting DHT22 and DS18B20 oneWire sensors direct to plotly with an Uno.
It's working well but the uno crashes when trying to send multiple streams. the guys at Plotly are investigating at the moment.
Instead I'm just using a single stream but a the moment you're limited to a single chart linked to a streamed data file, which is a shame because I'd like to have multiple charts directly linked to a single file.
root@Arduino:~# cd ~/Downloads/plotly_yun
-ash: cd: can't cd to /root/Downloads/plotly_yun
root@Arduino:~# scp -r Linino/* root@192.168.1.102:/root/
root@192.168.1.102's password:
Linino/*: No such file or directory
I cannot access the file which is in my pc and copy that plotly_yun file
opkg update
opkg install python-openssl #adds ssl support to python
opkg install distribute #it contains the easy_install command line tool (this can take some time)
easy_install pip #installs pip (this can take some time)
pip install plotly #(this can take some time)
After pip install plotly, I am waiting like 2 minutes and it is giving error:
This error some kind of windows error. There is no error on the terminal. After I wait 3-5min, I am getting this error and terminal is crashing down and I cannot write any command to the terminal anymore.
I upload the example sketch with my tokens and then I should get some http address with this commands:
root@Arduino:~# python run.py
python: can't open file 'run.py': [Errno 2] No such file or directory
root@Arduino:~# tail -f YunMessenger.log
tail: can't open 'YunMessenger.log': No such file or directory
tail: no files
As you can see, I cannot access these files and run them. I am using PuTTY terminal for this because of windows. I really dont figure it out how to install this Plotly libraries to Yun.
I also tried easy_install, but you have said that this can be disk space issue but there is space.
Can you give me suggestion about this problem, because I am stuck right now?
wait for few minutes and power cycle. This is will clean up every thing and reset to factory default.
opkg update
opkg install python-openssl #adds ssl support to python
opkg install distribute #it contains the easy_install command line tool (this can take some time)
easy_install pip #installs pip (this can take some time)
pip install plotly #(this can take some time)
I reseted Yun and then I wrote the commands based on your commands. This is the result, and again it failed. Here is the all codes...
root@Arduino:~# opkg update
Downloading http://download.linino.org/dogstick/all-in-one/latest/packages//Packages.gz.
wget: socket(AF_INET6,2,0): Address family not supported by protocol
Downloading http://download.linino.org/dogstick/all-in-one/latest/packages//Packages.sig.
Signature check failed.
Remove wrong Signature file.
Collected errors:
* opkg_download: Failed to download http://download.linino.org/dogstick/all-in-one/latest/packages//Packages.gz, wget returned 1.
* opkg_verify_file: Unable to open /var/opkg-lists/barrier_breakerroot@Arduino:~# opkg install python-openssl
Unknown package 'python-openssl'.
Collected errors:
* opkg_install_cmd: Cannot install package python-openssl.
root@Arduino:~# opkg install python-openssl
Unknown package 'python-openssl'.
Collected errors:
* opkg_install_cmd: Cannot install package python-openssl.
root@Arduino:~# opkg update
Downloading http://download.linino.org/dogstick/all-in-one/latest/packages//Packages.gz.
Updated list of available packages in /var/opkg-lists/barrier_breaker.
Downloading http://download.linino.org/dogstick/all-in-one/latest/packages//Packages.sig.
Signature check passed.
root@Arduino:~# opkg install python-openssl
Installing python-openssl (2.7.3-2) to root...
Downloading http://download.linino.org/dogstick/all-in-one/latest/packages//python-openssl_2.7.3-2_ar71xx.ipk.
Configuring python-openssl.
root@Arduino:~# opkg install distribute
Installing distribute (0.6.21-1) to root...
Downloading http://download.linino.org/dogstick/all-in-one/latest/packages//distribute_0.6.21-1_ar71xx.ipk.
Configuring distribute.
root@Arduino:~# easy_install pip
Searching for pip
Reading http://pypi.python.org/simple/pip/
Download error on http://pypi.python.org/simple/pip/: [Errno -2] Name or service not known -- Some packages may not be found!
Reading http://pypi.python.org/simple/pip/
Best match: pip 1.5.6
Downloading https://pypi.python.org/packages/source/p/pip/pip-1.5.6.tar.gz#md5=01026f87978932060cc86c1dc527903e
Processing pip-1.5.6.tar.gz
Running pip-1.5.6/setup.py -q bdist_egg --dist-dir /tmp/easy_install-LiB4u8/pip-1.5.6/egg-dist-tmp-2bX6Ki
warning: no files found matching 'pip/cacert.pem'
warning: no files found matching '*.html' under directory 'docs'
warning: no previously-included files matching '*.rst' found under directory 'docs/_build'
no previously-included directories found matching 'docs/_build/_sources'
Adding pip 1.5.6 to easy-install.pth file
Installing pip script to /usr/bin
Installing pip2.7 script to /usr/bin
Installing pip2 script to /usr/bin
Installed /usr/lib/python2.7/site-packages/pip-1.5.6-py2.7.egg
Processing dependencies for pip
Finished processing dependencies for pip
root@Arduino:~# pip install plotly
Downloading/unpacking plotly
Cannot fetch index base URL https://pypi.python.org/simple/
Could not find any downloads that satisfy the requirement plotly
Cleaning up...
No distributions at all found for plotly
Storing debug log for failure in /root/.pip/pip.log
