Suppose I have a large amount of data that I need to store in Non-volatile memory. I want to be able to upload new sketches and have that data persist. Right now I am including in my sketch, and accessing it when needed. However, as I develop my program, that data pool is growing, and is quickly going to surpass the memory limits of my device.
If I had some external non-volatile memory (would rather have EEPROM or FLASH chip, not SD card), would I be able to program that directly somehow?
Here's what I envision as a finished product: I have a sketch that is setup to read the data in 8 byte chunks, process it, and read the next 8 bytes, until it gets to the end. it does not need to save the data as it goes, so the 8 bytes would be overwrote each time it reads from the data.
I want to be able to upload new data directly to the memory, and then when the sketch runs again, it uses that new data. I will be designing a custom PCB for this, so I could have a connection for the SPI (or i2c, whatever the interface), and hook that second Arduino up to reprogram the data pool.
My issue is that my data could grow to over 200KB, so I can't just upload the whole thing to the second Arduino, and have it write to the EEPROM.
If there is anyone left reading this long winded post.....my question is, what would be my best option (outside of just reading from SD card) to make this work. Are there programs out there that I can program EEPROM right from my PC? I'm sure if can be done through a sketch on the second board and sending the data via serial, but that seems messy.