Timeline for Scraping campsite availability from a webpage using vba with selenium
Current License: CC BY-SA 4.0
8 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Mar 27, 2022 at 9:23 | comment | added | Nelj | @Ryan Wildry Is there a way to put a wait to the code, as the webpage is performing a browser check before providing the required information? Sorry I am new to json web scraping. | |
| Mar 27, 2022 at 8:56 | comment | added | Nelj | @Ryan Wildry I managed to get the code running by copying it to a new workbook. It seems that the old workbook’s selenium reference caused the error (That’s all I can think). The json converter provides the required information almost instantaneously. | |
| Mar 11, 2022 at 13:57 | comment | added | Ryan Wildry |
@Nelj This is a weird error, I don't see STATUS listed in the keys for code above. It might be related to requiring a reference to Microsoft Scripting Runtime the json parser uses this data structure to deserialize the data.
|
|
| Mar 11, 2022 at 4:54 | comment | added | Nelj | Ryan Wildry - Thank you Ryan for having a look. I have followed the instructions and got the following error: KeyNotFoundError - Dictionary key not found: STATUS The error is on the following line: "json_ParseObject.Item(json_Key) = json_ParseValue(json_String, json_Index)" | |
| Mar 11, 2022 at 4:50 | comment | added | Nelj | Greedo - I had my vba code checking the availability on IE and not through a webdriver. This took about 2 seconds to complete. | |
| Mar 8, 2022 at 13:32 | comment | added | Ryan Wildry |
I used the network tab in Chrome to via the web requests back and forth on the page. I noticed one of the endpoints had API in the URI, so I took a peek at what was included in the response. It was the JSON that feeds into the calendar on the page.
|
|
| Mar 7, 2022 at 22:04 | comment | added | Greedo | Out of interest, how did you inspect the traffic, what was the process? | |
| Mar 7, 2022 at 21:18 | history | answered | Ryan Wildry | CC BY-SA 4.0 |