Skip to main content

All Questions

0 votes
1 answer
268 views

How to set Network Preference parameters for headless browser PhantomJS with Python and Selenium

How to implement below profile set preference for Phantomjs headless browser. def browser(): print("Setting up webdriver connection...") global driver if driver is None: profile = ...
Sum's user avatar
  • 363
0 votes
1 answer
385 views

selenium python not working with phantomjs but works with Firefox

I am try to sort by most recent option using below code but it gives below error Error Message: {"errorMessage":"Unable to find element with css selector 'span.sortedLabel'","request":{"headers":{"...
Saurabh's user avatar
  • 59
0 votes
1 answer
95 views

PhantonJS and Green GreenPile crash using python

I'm trying to lunch multiple instances of PhantomJS and using the driver between the threads instead of destroying it and create the process again and again : import sys from datetime import datetime ...
USer22999299's user avatar
  • 5,714
-1 votes
1 answer
479 views

TimeoutException using EC.text_to_be_present_in_element with phantomjs

I'm using Python 2.7.13, Selenium version 3.3.3 and PhantomJS 2.1.1 downloaded from https://phantomjs.org. If I run the following script on Fedora 25 (or Windows 7) it runs fine with Firefox but ...
Edward's user avatar
  • 33
3 votes
1 answer
2k views

Python Selenium wait for innerHTML

I'm trying to wait for the innerHTML element to load. Here is the generic version of my code: element = WebDriverWait(driver, 120).until(EC.presence_of_element_located((By.XPATH, XPATH))) element = ...
In_Circ's user avatar
  • 83
2 votes
0 answers
137 views

PhantomJS with selenium doesnt scroll to bottom

With Firefox driver, the below code works(scrolls to bottom of page) but not with PhantomJS webdriver. The below page has infinity scroll so I need to scroll down to gather more information. Kindly ...
Lawrence Muriuki's user avatar
1 vote
0 answers
240 views

Webdriver with PhantomJS works in terminal shell but not in PyCharm on Mac OS

I have used brew to install selenium(webdriver): $ phantomjs --version 2.1.1 Then, I try to run this code in pycharm but get error: from selenium import webdriver if __name__ == '__main__': ...
Haomao Wang's user avatar
1 vote
0 answers
147 views

how can i use browsersec extension in phantomjs

browsersec is a vpn extension for chrome and Firefox but i like to use it for phantomjs here is my code without any extension from selenium.webdriver.support.ui import WebDriverWait service_args=[] ...
Pavan Kumar T S's user avatar
0 votes
1 answer
294 views

With selenium I do not get the data

I have with successfully navigated to an iframe with selenium + phantomJS but I do not get the data. If I look the iframe url in Midori browser I can see the result. But with webdriver without the ...
vatay's user avatar
  • 387
1 vote
1 answer
2k views

python, selenium: unable to get raw html from javascript

I have read that to render javascript to scrape the raw html, I will need to use selenium and a webdriver like phantomjs. However, doing so still does not render the javascripts for me. Below is a ...
Jake's user avatar
  • 2,963
1 vote
1 answer
258 views

Selenium with PhantomJS URLError( Works in Windows fails in Ubuntu16.04)

My scraping code works perfectly in my local computer(Windows 8) but fails in Digital Ocean droplet(Ubuntu 16.04)..Always fails on the second loop giving Bad Status Line or URLError..Have already ...
Lawrence Muriuki's user avatar
1 vote
0 answers
334 views

Python selenium phantomJS cookies on angular app

So i am working an a small testing tool using PhantomJS in python with selenium and the website i'm using it on uses the following script to determine if cookies are enabled or not var tc = '...
Nick's user avatar
  • 675
-1 votes
2 answers
249 views

Python Selenium Element does not exist

Been struggling to click a certain nested li in a ul. Each attempt throws an error. Im trying to use xpath however any approach would be welcome. Also take into consideration that there is some extra ...
Peter Cunningham's user avatar
1 vote
0 answers
448 views

Python/Selenium: Scraping page for links and scraping links

I am attempting to scrape Fodor's website for all of it's choice restaurants in Amsterdam. I am able to pull the name, price range, and cuisine type from the initial page that the link takes you but I ...
wavey's user avatar
  • 295
0 votes
1 answer
968 views

Using PhantomJs with Python/Selenium

I am attempting to you PhantomJS in order to run my webscrapes with Selenium and Python without needing to open up a new window when the scrape loops into the next page. I consulted this post ...
wavey's user avatar
  • 295

15 30 50 per page