How do I pull inner elements from a Selenium web element in Python?

Question

I'm trying to use Selenium to pull the stock symbols from this page and insert them into a list: https://www.barchart.com/stocks/highs-lows/highs?timeFrame=1y

My code:

StockList = []

driver = webdriver.Chrome()
url = "https://www.barchart.com/stocks/highs-lows/highs?timeFrame=1y"
driver.get(url)

stock_list = driver.find_elements_by_tag_name("tr")
for stock in stock_list:
    stock.find_element_by_name("data-current-symbol=")
    print(stock)

I receive a NoSuchElementException.

When I inspect the page, each tr has the following: "data-current-symbol="ACY

How can I pull out the stock symbol?

I guess, the = should not be there in instock.find_element_by_name("data-current-symbol=") — Jonathan Herrera
– Jonathan Herrera, Commented Sep 27, 2021 at 4:16
Removed = and changed to stock.find_element_by_name("data-current-symbol") - it didn't work. — Adam
– Adam, Commented Sep 27, 2021 at 4:19

frianH · Accepted Answer · 2021-09-27 04:19:26Z

1

Use this selector:

tr[data-current-symbol]

And utilize .get_attribute method:

StockList = []

driver = webdriver.Chrome()
url = "https://www.barchart.com/stocks/highs-lows/highs?timeFrame=1y"
driver.get(url)

stock_list = driver.find_elements_by_css_selector("tr[data-current-symbol]")

for stock in stock_list:
    symbol = stock.get_attribute('data-current-symbol')
    print(symbol)
    StockList.append(symbol)

answered Sep 27, 2021 at 4:19

frianH

7,5916 gold badges26 silver badges49 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How do I pull inner elements from a Selenium web element in Python?

1 Answer 1

Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Related