Parsing CSV files or alternate storage of data

Other Hardware Storage
1

Hello, everyone. I looked in this thread but don't seem to find a solution.

I have to store a lot of string data (random sequence of characters basically) with 4 word variables attached to them. So in table terms that 5 columns with 1000 rows. I have to be able to look for a string in the first column and then get all word variables from that row, process them and perform the function.

I know how to create a file, add a cell with data, start a new row, is it possible to search for the cell with data? Also don't know how to delete a row with left rows shift and how to rewrite a cell.

If not possible, how do I store what is basically an array of arrays with no restrictions on power loss?

Converting types of variables is not a problem.

Thanx in advance.

2

If you want to search your file, the most fundamental method is to read it line by line until you find what you're looking for. May be too slow for your needs.

If you sort the file in advance you can use seek to do a binary chop to find the line faster. It will help here if the lines are fixed length.

You might consider putting the data in a FRAM - Adafruit has one that'll hold 512K.

You can get a micro controller that has enough memory to read the entire file into RAM and work with it there. Teensy 4.0 for example.