So I have this big set of data on Cosm/Pachube that I want to automatically take the area under the curve during specific time frames. This calculation should be performed once a day, at the end of the day. Now, I am perfectly aware of how to do this with Excel using the area of trapezoid formula, but it takes manual effort. Automatic would be key for my application. I want to do this every day and store the timestamp it was performed and area under the curve value.
I am trying to brainstorm different ways to do this. The two things I could come up with are:
-GET a single day's worth of data from cosm and store it in a server side database. Then some how do the area under the curve calculation and store it's value in the same database.
-Do an "on the fly" type calculation inside some type of programming language. GET each single data point from Cosm, store it temporarily in a variable while doing a calculation then load in a new variable and keep going until the last datapoint is calculated. Then store that number in an array that has the date created and the value.
I don't know much at all about databases and would like to start with a very basic database that would be easy to learn (if that is needed). I just want something that I can calculate the area under the curve and look at the data on a website everyday.
If there is an easy way to dissect the Cosm data that I don't know about. Or if someone could make some very general/basic suggestions on how to start with this, that is what I'm looking for. Many thanks in advance and please forgive me if I haven't done enough homework before posting here.