51,751 questions
-1
votes
0
answers
10
views
How can I reliably scrape the Meta Ads Library for the latest ad launches?
I’m building a scraper to monitor the Meta (Facebook) Ads Library for new ads as soon as they start running.
From inspecting network requests, I see that the Ads Library web app uses a GraphQL ...
0
votes
1
answer
63
views
GET requests with Python return long string [closed]
i'm trying to develop tools for my sport club and for that i would like use an API requests with python automatically obtain information from french handball federation website.
For that a use a ...
1
vote
0
answers
10
views
Cannot access 'iwe-autocomplete' element in html with selenium
Website photo with search box visible.
So, this is the website
https://sa.ucla.edu/ro/public/soc
There is a dropdown menu for selecting subject area where I need to write subject and i will receive ...
-2
votes
1
answer
63
views
Webscraping, cannot find page element [closed]
I'm currently trying to scrape the links off of a webpage: https://www.mfat.govt.nz/en/media-and-resources?categories=ministry_statements_speeches,news&page=1
My goal is to collect all of the ...
- 89
0
votes
2
answers
75
views
Webscraping using R
I am attempting to scrape the following page
https://www.nba.com/stats/players/rebounding?Season=2024-25&DateFrom=10%2F22%2F2024&DateTo=10%2F22%2F2024
I have created a loop so that it scrapes ...
-4
votes
0
answers
37
views
Anti bot detection while webscrapping using playwright [closed]
For scraping sky scanner website, I am using playwright in python and my script is working but i am getting caught as bot it detects and takes me to captcha page. So I can't scrape website content.
I ...
- 1
0
votes
0
answers
93
views
Downloading Barchart.com table using Excel VBA
I'm trying to download the barchart data table from https://www.barchart.com/investing-ideas/ai-stocks
using Excel VBA in similar manner as the python script in Automatic file downloading on Barchart....
- 1
-1
votes
1
answer
49
views
Selenium script marks all search results as “not found” because details load only after clicking a link [closed]
I’m using Python + Selenium + ChromeDriver to check a list of titles (from a CSV file) against an online library catalog.
My script searches each title and tries to determine if a specific library has ...
- 1
3
votes
2
answers
130
views
Importing a table from a webpage as a dataframe in Python
I am trying to read in a specific table from the US Customs and Border Protection's Dashboard on Southwest Land Border Encounters as a dataframe.
The url is: https://www.cbp.gov/newsroom/stats/...
- 2,023
-1
votes
1
answer
106
views
Webscrape links to download files based on word in page HTML
I am webscraping WHO pages using the following code:
pacman::p_load(rvest,
httr,
stringr,
purrr)
download_first_pdf_from_handle <- function(handle_id) {
...
- 323
1
vote
2
answers
139
views
Scraping booking.com with PHP Curl [closed]
I'm trying to setup a simple php script (below) to check when a certain property becomes available on booking.com.
The site seems to work with some pretty simple query parameters - you can just go ...
- 69
0
votes
0
answers
55
views
Unable to scrape product price from Shein ShareJump links in Laravel/Python
I’m working on a project in Laravel/Python where I want to fetch product information from Shein, but I’ve run into a major problem with ShareJump links.
Here’s an example link I’m working with:
http://...
1
vote
1
answer
109
views
Scraping archived content [closed]
I am a bit new to webscraping and trying to build a scraper to collect the title, text, and date from this archived page:
from selenium import webdriver
from selenium.webdriver.chrome.service import ...
- 89
1
vote
2
answers
72
views
Cannot click <a> element button with href="javascript:void(0)" with selenium
I'm using selenium in python and trying to click the "See all Properties" button to get to the next web page where all the properties will be listed and I can easily scrap the data.
Here's ...
0
votes
0
answers
150
views
Scraping Instagram Likes at Bulk
My goal is to find out if a given user has liked any post of another profile.
So the following question has to be answered: Has the user X liked any post on the profile Y in the past 24 months.
For ...
- 300