All Questions
55 questions
0
votes
1
answer
85
views
Extracting p from div class python to get addresses
Currently the code: Finds the urls for all gyms and puts in csv like so:
https://www.lifetime.life/life-time-locations/al-vestavia-hills.html
https://www.lifetime.life/life-time-locations/az-biltmore....
0
votes
0
answers
90
views
How do I scrape a specific HTML tag?
I'm making a 3 letter username checker that checks against a web address where it's displayed in plaintext if the username is taken or not. It is inside of a <pre> tag and since the website is ...
1
vote
2
answers
52
views
Trying to get the texts between this tag but getting an empty list
\Trying to get the texts A Plus and Computers from this html:
<div class="u-space-t1">
<h1 class="biz-page-title embossed-text-white shortenough">A Plus</h1>
<div ...
- 141
1
vote
1
answer
100
views
Python Web-Scraping Table
I am trying to scrape some data from a website using pythin. The website contains a lot of different workouts that each have their own data. I have figured out how to scrape the data from each ...
- 45
0
votes
1
answer
194
views
Extracting text from multiple links and storing independently
I am Data Analyst, know ML and DL, but my web scraping is not good.
I am scraping data. What I am trying to do is the following:
using duckduckgo API, I extract all the link for a query, query is ...
- 171
0
votes
1
answer
43
views
Unable to get the names of the website when using pattern in python
There is the error in the code when try to fetch the names from the website, but when fetching the amount then it gives the amount perfectly
Here is the code when trying to fetch the Amount of the ...
- 17
0
votes
2
answers
45
views
Unable to format the HTML output
I have python code that returns an HTML page. Within that page, there is a line "2092 Pittman Road" which is the parcel address. My code is below:
import mechanize
br = mechanize.Browser()
response = ...
- 37
0
votes
3
answers
6k
views
Python Web scraping with Beautiful Soup 3: how to get text from div
Here's what the HTML I'm having trouble with looks like,
<div id="id" class="class">
text
</div>
Say I have a variable with the Soup in it,
div = find('div', attrs={'class': 'class'})
...
- 305
1
vote
1
answer
52
views
Not able to select links from a module on a website using BeautifulSoup
I have build a scraper to extract links from a company's website (I have permission), however when I try to add in the url where the jobs are posted, I'm only able to retrieve some of the links. It ...
- 99
0
votes
1
answer
615
views
Extracting tags from a HTML with data hidden using python
I'm trying to learn scraping from different webpages. I tried to scrape data from a page containing tabs as follows:
url = "https://www.bc.edu/bc-web/schools/mcas/departments/art/people/#par-...
- 311
1
vote
1
answer
94
views
BeautifulSoup - Parsing doesn't return expected tags
I'm trying to scrape a website for property sales data.
However, the parsing doesn't return what I expect. The length of sales_containers is simply 0. I know, from inspecting the website, that there ...
- 13
1
vote
1
answer
377
views
Extracting href from <a> which has a download option using python [duplicate]
I'm trying to scrape the contents of a tag. Here is a example of the html:
<p><a href="https://requiredlink.com" download>Download<span class="caret">
Here is what I'm doing:
r = ...
- 311
1
vote
2
answers
644
views
Extracting text between tags using a particular word
I'm trying to extract text between tags of a HTML page using a keyword. Here is an example.
<div class="xyz">Title</div>
<h4>Education</h4>
<p>PhD, 2017, Subject,<br /...
- 311
0
votes
1
answer
41
views
Python2.7 getting the next tag by using bs4
I have the part of the html from
http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=1&p=1&f=G&l=50&d=PTXT&S1=V2V&...
1
vote
1
answer
1k
views
BeautifulSoup </div> scraping suddenly stopped working
I am trying to scrape some divs from a NASA website and put all the contents in a list. THIS CODE WAS WORKING EARLIER and has suddenly decided not to. I didn't change anything knowingly except to add ...
- 2,534