Timeline for Scraping with asyncio/aiohttp and retrying the request on error
Current License: CC BY-SA 3.0
3 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Apr 10, 2018 at 21:54 | history | edited | J_H | CC BY-SA 3.0 |
clarified that there are two kinds of hosts: intermediate proxy + final webserver
|
| Apr 10, 2018 at 17:19 | comment | added | antfuentes87 | I changed proxy to proxy_url. Do you have an example of tracking these health details? Also, what do you mean adaptive timeouts? Timeouts that change based on the health details? When you say dead hosts, are you referring to the server I am requesting or the proxy I am requesting? An example of what you mention would be great. Regardless, thank you for your input and taking your time reading my code. | |
| Mar 31, 2018 at 3:32 | history | answered | J_H | CC BY-SA 3.0 |