ESP8266 how to copy a complete website and then analyze it ?

Projects Programming
1

Hello falks, I need your help,

I've an ESP8266. I want my ESP let open a website like this:

and analyze the data in it, for example the current bit price. The Problem at this example is: there is no file which the "ESP8266HTTPClient.h" library can read out. As you can see on this example, there is only a folder named "ESP8266HTTPClient.h".

If there was an actual file like "index.htm", than it would be no problem for me to analyze the website-content.

Can someone please help me out ?

2

It does not matter if it is a file or not. If that URL is requested and something is send back, then you can read what is send back. If you want to save it to a file, then give it a name, for example "get.txt".

The next code crashes the ESP32, I think that too much data is send back. The URL for that Ebay page returns 500kbyte. The price information is in the 500kbytes, it should be possible to retrieve it from the data.

  WiFiClientSecure client;
  HTTPClient http;

  http.begin(client, url);
  http.GET();
  Serial.print(http.getString());
  http.end();
3

Hello

Maybe look at the ebay API, for example : GetItem - API Reference - Trading API

4

read index.php and analyse which part reloads the content.

PS.: there are for sure other tools to track items on EBAY.

5

Okay, this was a good idea. Thanks man.