Timeline for Scraping content from a javascript enabled website with load more button
Current License: CC BY-SA 3.0
10 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jul 14, 2017 at 17:18 | comment | added | SIM | Tried and got the results as I get always with your code. Thanks a zillion sir. | |
| Jul 14, 2017 at 17:00 | comment | added | alecxe | @SMth80 oops, I am an idiot - was a typo, please try now. | |
| Jul 14, 2017 at 17:00 | history | edited | alecxe | CC BY-SA 3.0 |
added 8 characters in body
|
| Jul 14, 2017 at 16:49 | comment | added | SIM | I ran your code sir alecxe. It does get to the bottom of the page exhausting load more button, but prints nothing in the console. I suppose the selectors might need a little twitch. Thanks. | |
| Jul 14, 2017 at 14:40 | comment | added | alecxe | @SMth80 you are welcome! I actually enjoy reviewing your code - I can see you are improving the code quality and web-scraping skills quickly. If you want to further optimize this code, please post separately with "performance" tag - I think there may be ways to make the "load more" and other parts faster. Thanks. | |
| Jul 14, 2017 at 14:38 | comment | added | SIM | Thanks sir for the review along with an epic script. This is by far the best code on python + selenium I've ever come across . What I did in [while true block ,as in firstly waited then clicked] was making my browser run slowly. You rectified that and now it is working very fast. I'm unable to wait to see the full results as I'm getting busy otherwise. However, I observed for a few minutes and found it running very fast. 'll give you the feedback when I'm free. Thanks again sir. | |
| Jul 14, 2017 at 14:18 | vote | accept | SIM | ||
| Jul 14, 2017 at 13:59 | history | edited | alecxe | CC BY-SA 3.0 |
added 4 characters in body
|
| Jul 14, 2017 at 13:54 | history | edited | alecxe | CC BY-SA 3.0 |
added 2500 characters in body
|
| Jul 14, 2017 at 12:32 | history | answered | alecxe | CC BY-SA 3.0 |