All Questions
128 questions
0
votes
0
answers
45
views
Selenium Twitter Scraper Closes Immediately – Not Detecting New Tweets
I'm trying to write a Selenium script that scrapes Twitter for new tweets from a specific user after the script starts running. The goal is to print and save tweets to a CSV if they are posted after ...
- 309
2
votes
2
answers
71
views
Python Selenium script not retrieving product price from a webpage
I'm trying to scrape product prices from the website Ultra Liquors using Python and Selenium, but I'm unable to retrieve the price despite the HTML containing the expected elements. My goal is to ...
- 23
1
vote
0
answers
106
views
using Selenium on R for web scraping of dynamic content
I am quite new on R and am currently trying to do web scrapping on the ISO website. I have trouble using Selenium : it does not seem to be compatible with my chrome version, despite me trying to ...
- 11
0
votes
1
answer
73
views
TypeError when running selenium web driver
I'm currently in the middle of an online python course and have been mostly progressing without issue, or at the very least eventually being able to solve them, however this one has me stumped. I'm ...
1
vote
2
answers
346
views
How to change currency in booking by selenium
I'm trying change currency on USD in booking.com website by Selenium
but I got a little problem with "click" on USD sign. My code always set first Currency from list, which is EURO. I see ...
- 61
0
votes
2
answers
340
views
Can't get element with Python Selenium find_element(By.CSS_SELECTOR)
I'm having trouble getting a specific element in the page I want to scrape. The content is wrapped in a weird tag, and not sure if it's an iframe. I also tried with CSS_SELECTOR, but anything coming ...
- 341
0
votes
2
answers
163
views
Unable to get an element using Selenium
I have been unable to get the rating number from the website https://www.hoka.com/en/us/mens-everyday-running-shoes/rincon-3/1119395.html using selenium.
This is what I have as Python code:
from ...
- 5
1
vote
3
answers
1k
views
How can I extract the text from a webelement using selenium
Here I have tried to access leetcode question title, which are available on the given link. However I seem to not be able to access the text in the specified web element. The error I get says:
...
- 23
0
votes
1
answer
32
views
Selenium Using Python - I couldn't take elements by CSS_SELECTOR
I want to select a list of items using a CSS selector. However, when I try to retrieve the elements on the page, I am only getting three items, even though there should be 50 items. After inspecting ...
-1
votes
1
answer
1k
views
How to construct locators for dynamic elements using Selenium and Python
I am working on web scraping from LinkedIn. I have a filter for roles on a sales navigator page. Here I need to add filter for roles using python.
driver.find_element(By.XPATH,"//[@id='ember219']...
- 151
2
votes
2
answers
114
views
Selenium WebDriverWait TimeoutException When Trying to Fetch Data into Pandas DataFrame
Hello Stack Overflow community,
I'm currently working on a Python script that involves fetching data from a webpage and storing it in a pandas DataFrame. However, I'm encountering an issue where the ...
1
vote
1
answer
301
views
How to find HTML elements by multiple tags with selenium
I need to scrape data from a webpage with selenium. I need to find these elements:
<div class="content-left">
<ul></ul>
<ul></ul>
<p></p>...
- 103
-1
votes
1
answer
48
views
WeatherUnderground Web Scraping - choosing different measurements systems
I've been trying to change measurements systems. Default measurement system on the WeatherUnderground is set on imperial system.
from selenium import webdriver
from selenium.webdriver.common.by import ...
1
vote
1
answer
480
views
How to get the get data from span using Selenium Python
How to get the get data from span using Selenium Python.
Code trials:
import time
from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager
from selenium.webdriver.common....
-1
votes
2
answers
81
views
Unable to scrape text using By.CLASS_NAME in selenium
Every time I try to scrape the HTML of a page I get the same error:
selenium.common.exceptions.InvalidSelectorException: Message: invalid selector: An invalid or illegal selector was specified
I know ...
- 1