All Questions
121 questions
0
votes
1
answer
87
views
web-scraping using R selenider on linux error --user-data-dir
I'm attempting to web-scrape using the following R code (which was obtained from this thread: link to other question
library(selenider)
library(rvest)
session <- selenider_session("selenium&...
- 41
1
vote
1
answer
47
views
Scraping Collapsible Table in R
I am using R Selenium to collect data from a collapsible table. I have been successful in scraping the main table, but I would also like to collect the sub-table data for each company.
library(...
- 11
1
vote
1
answer
67
views
Scraping text in whitebox
I am trying to collect some Dutch historical election data. Below you see the code I have been using. I still need to figure out how to iterate the process for every 'Gemeente', but my main problem ...
- 115
0
votes
1
answer
64
views
Can not get information from a website using RSelenium
I would like to use RSelenium to scrape a webpage to check if a certain text exists.
I need to click on Staatsangehörigkeitsangelegenheiten followed by clicking 02. Antrag Einbürgerung [sorry as the ...
- 1
1
vote
1
answer
76
views
simulate scrolling in Rselenium or selenium in python
I am trying to scrape this website. You need to click on the magnifying galss icon in the search bar to see the records I want to extract. The issue is that the website is dynamic and I need to scroll ...
1
vote
0
answers
106
views
using Selenium on R for web scraping of dynamic content
I am quite new on R and am currently trying to do web scrapping on the ISO website. I have trouble using Selenium : it does not seem to be compatible with my chrome version, despite me trying to ...
- 11
2
votes
2
answers
109
views
Multiple tags getting captured while web scraping Reddit in R using RSelenium
enter image description hereI was writing code to web scrape the post title, comments and author names from a reddit post for a project.
I am able to web scrape the post title, author names but the ...
- 33
5
votes
2
answers
78k
views
How to find a chrome driver for my chrome version?
I am trying to install RSelenium for webscraping but am not able to get a chromedriver that matches with my current chrome version. I do not want to downgrade to an older google chrome as that seems ...
- 53
-1
votes
1
answer
253
views
web scrape espn box score data in R
I am very new to web scraping and I am trying to extract all of the information in the box score tables for the NHL for certain games. For example, for game with the id of 401459058, it is all of the ...
- 355
0
votes
2
answers
64
views
web scrape all items in a page with selenium
I am trying to bring all items in the webpage-for instance I would like to bring the first
"Hillebrand Boudewynsz. van der Aa (1661 - 1717)"
and then all the other 49 in the page
MY code is ...
- 537
1
vote
1
answer
417
views
Getting 'Undefined error in httr call' when using remDr$navigate with R Selenium - how to fix it?
remDr$navigate (url) error: Undefined error in httr call. httr output: length(url) == 1 is not TRUE
This happens for URL
url <- "https://eprel.ec.europa.eu/screen/product/airconditioners" ...
- 13
1
vote
0
answers
218
views
Scraping google reviews using Rselenium in R
I am exploring how to scrape google reviews using rselenium:
Here is my code
library(RSelenium)
library(wdman)
library(netstat)
library(data.table)
library(tidyverse)
library(rvest)
rD <- rsDriver(...
- 1,002
1
vote
1
answer
366
views
Scraping multiple tabs under the same page using Rselenium
I need to scrape the multiple tabs within the same page. (I need to scrape Summary, attack and other tabs that falls under Player Statistics)
webpage: https://www.sofascore.com/southampton-...
- 1,002
1
vote
1
answer
476
views
Web scraping data inside a tab using Rselenium
I want to scrape the summary table under Player statistics in the following page:
https://www.sofascore.com/southampton-wolverhampton/dsV
I am trying to use RSelenium for this purpose
Here is my code ...
- 1,002
3
votes
5
answers
1k
views
RSelenium fails to open browser
I wan't to use Selenium for webscrapping from R.
My Windows version: Windows 11, 21H2
I have the latest Java update. (1.8.0_351) Commenting it since I've seen it could be a fix in this cases.
...
- 43