Pages: 1 [2] 3 4   Go Down
Author Topic: Importing a large lookup table  (Read 2023 times)
0 Members and 1 Guest are viewing this topic.
Global Moderator
Offline Offline
Brattain Member
*****
Karma: 495
Posts: 19036
Lua rocks!
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

How about posting the file? Or at least the first few lines of it.
Logged


France
Offline Offline
Edison Member
*
Karma: 38
Posts: 1012
Scientia potentia est.
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

It should work, are you sure the baud speed is the same in the serial monitor window?
Logged

Global Moderator
Offline Offline
Brattain Member
*****
Karma: 495
Posts: 19036
Lua rocks!
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

How big is this file, anyway? How many numbers are in it?
Logged


Seattle, WA USA
Offline Offline
Brattain Member
*****
Karma: 631
Posts: 50115
Seattle, WA USA
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
It compiles flawlessly but the serial monitor shows nothing (should show "tizio")!
On what version of the IDE? Prior to 1.0.1, the failure of the compiler to find an include file was a fatal error. With 1.0.1, the failure to find an include file doesn't even generate a warning.

The failure to find the include file would explain the behavior you are seeing.
Logged

Maryland, USA
Offline Offline
Jr. Member
**
Karma: 0
Posts: 79
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

How about posting the file? Or at least the first few lines of it.
Eventually, my goal is to import a bidimensional array of numbers, but right now, for testing purposes I am experimenting with the following:
The entirety of "mydata.hh" contains the following text:
Code:
"tizio", "caio", "sempronio"
The entirety of "numbers.hh" contains:
Code:
1,2,3,4
How big is this file, anyway? How many numbers are in it?
"mydata.hh" on disk is 30 bytes long.
"numbers.hh"on disk is 9 bytes long.
It should work, are you sure the baud speed is the same in the serial monitor window?
Yes I made sure they are the same.
With 1.0.1, the failure to find an include file doesn't even generate a warning.
The failure to find the include file would explain the behavior you are seeing.
I am using 1.0.1
If I don't put the whole path, the compilers gives me an error: "No such file or directory".

Thanks for your help.



Logged

There are three kind of people in the world: Those who can count, and those who can't

Maryland, USA
Offline Offline
Jr. Member
**
Karma: 0
Posts: 79
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

Ok, this is maddening!

This morning, after posting the reply above I re-run the sketches without changing anything and they work!

One thing that I did not mention is that yesterday, after changing something here and there and re-verifying I was getting a bunch of random errors that did not make much sense, such as that I already declared variables that were not even in the sketch anymore.....

Next I will actually try to import my large bidimensional array with the same method and I may reach for help again, but thank you for taking the time to answer.

One thing: does Arduino work better in daytime?
Any problem with full moon?   smiley

Logged

There are three kind of people in the world: Those who can count, and those who can't

Global Moderator
UK
Offline Offline
Brattain Member
*****
Karma: 308
Posts: 26474
I don't think you connected the grounds, Dave.
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
I was getting a bunch of random errors
I've never heard of a compiler producing random errors.
Logged

"Pete, it's a fool looks for logic in the chambers of the human heart." Ulysses Everett McGill.
Do not send technical questions via personal messaging - they will be ignored.

Seattle, WA USA
Offline Offline
Brattain Member
*****
Karma: 631
Posts: 50115
Seattle, WA USA
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
I've never heard of a compiler producing random errors.
Incomprehensible, infuriating, annoying, yes. Random, no.
Logged

Maryland, USA
Offline Offline
Jr. Member
**
Karma: 0
Posts: 79
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
I've never heard of a compiler producing random errors.
Incomprehensible, infuriating, annoying, yes. Random, no.

Perhaps random was not the right term, incomprehensible is better.

I was getting something like (I don't remember it verbatim and the error did not show up again, this morning):
variable char[] already defined
when I never defined a variable called char[].
In a previous sketch I had defined
char* data[]

Maybe there is some reason for it {the pointer was still in the computer/arduino memory ??) 
But if there is it is definitely not obvious  smiley-mad

Logged

There are three kind of people in the world: Those who can count, and those who can't

Offline Offline
Edison Member
*
Karma: 116
Posts: 2205
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
The entirety of "numbers.hh" contains:

That wouldn't be the right way to go.

You need two files:

numbers.h:
Code:
//header file for numbers

extern const unsigned char mydata[];

numbers.c/ino/pde
Code:
#include "numbers.h"

const unsigned char mydata[]={
  1, 2, 3, 4,
  ...
};

In your user application, you simply include numbers.h in order to reference mydata[].
Logged

Maryland, USA
Offline Offline
Jr. Member
**
Karma: 0
Posts: 79
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

Ok, I think I did it.
I found a way to keep a large array of data in a separate text file and importing it in my sketch as an #include.
The advantages of doing that are:
-  you can modify and update your data file without touching the sketch.
-  you don't have to put an unsightly long declaration in your code.
-  you don't even have to re-verify your code after modifying the data but you have to re-upload it

I thought this was a fairly established thing to do but I could find hardly any documentation.
I am posting my solution here hoping it may be helpful to some other newbie.

Code:
/* This examples illustrates how to import numeric data from a separate Text file

   By Luca Brigatti - 2012
   witht he help of the folks in the Arduino programming forum.

   Note: Leaving the first dimension empty: data[][2]
   and using: sizeof(data)
   to calculate the size of the array in bytes eliminates the need to know beforehand
   how many values are there in the file.
  
   The operation: maxIndex = sizeof(data) / 4 - 1
   return the highest index number of the first dimension:  data[maxIndex][2]
   The denominator (4 in this case) is the product of the number of bytes per data type (2 bytes per integer)
times the size of the second dimension ([2] in this case)
  
   The text file being read: "numbers2.hh"
   contains something like that:
   ________________________
   // Example of bidimensional numeric data array
   // The actual numbers can be any int (if the data array is int)
  {1,1},
  {-2,4},
  {3,-9},
  {4,}, // Second element here will be 0, Like:  {4,0},
  {-5,-25},
......
_________________________________

Note: {,4},   i.e leaving the first place empty is NOT allowed. 
*/

// Main importing instructions. data[][2] can be a variable
static const int data[] [2] = {  
// Put the name of the file with the complete Path
#include "E:\Downloads\Devices\Arduino\arduino-1.0.1\data\numbers2.hh"
};

int maxIndex ;
int arraySize ;

void setup() {
  
  Serial.begin(9600); // Initiate serial
  
  arraySize=sizeof(data);  // Gets the size of the array in bytes
  maxIndex = arraySize/4 - 1; // Size /2 (bytes in an int) /2 (for a bidimensional array) - 1 (as index starts at 0)  
  
  // Print dimensions of the array
  Serial.print("Array Size (bytes): ");
  Serial.println (arraySize);
  Serial.print ("# of rows: ");
  Serial.println(maxIndex+1);
  
  delay(2000);
}

void loop () {
  
  // Print all the data in the array, over and over again
  for (byte i=0; i<=maxIndex; i++) {
    Serial.print (data[i][0]);
    Serial.print (" , ");
    Serial.println (data[i][1]);
  }
  delay(500);
    Serial.println();
  
}
Logged

There are three kind of people in the world: Those who can count, and those who can't

Seattle, WA USA
Offline Offline
Brattain Member
*****
Karma: 631
Posts: 50115
Seattle, WA USA
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
-  you don't even have to re-verify your code after modifying the data but you have to re-upload it
Yeah, right. Perhaps you want to enable verbose output when you compile, but not when you upload. Then, see what happens when you click Upload.
Logged

Offline Offline
Edison Member
*
Karma: 116
Posts: 2205
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

"I  am posting my solution here hoping it may be helpful to some other newbie."

That approach works if the data is referenced from one source file.

If you want to reference the data from multiple files, you have to split it into .c and .h files.
Logged

Seattle, WA USA
Offline Offline
Brattain Member
*****
Karma: 631
Posts: 50115
Seattle, WA USA
View Profile
 Bigger Bigger  Smaller Smaller  Reset Reset

Quote
If you want to reference the data from multiple files, you have to split it into .c and .h files.
Of course, it would be a lot easier if you used .cpp and .h files.
Logged

Maryland, USA
Offline Offline
Jr. Member
**
Karma: 0
Posts: 79
View Profile
WWW
 Bigger Bigger  Smaller Smaller  Reset Reset

That approach works if the data is referenced from one source file.

Yes, that was exactly my goal:
ONE file, separate from the sketch itself, containing all my data.

Besides, nothing would prevent me to use another #include for a different set of data:

Code:
static const int data[] [2] = { 
#include "E:\DataPath\numbers2.hh"
};

static const byte other_data[] [3] = { 
#include "E:\DataPath\other_numbers.hh"
};
Logged

There are three kind of people in the world: Those who can count, and those who can't

Pages: 1 [2] 3 4   Go Up
Jump to: