All Questions
2,758 questions
0
votes
3
answers
83
views
How to extract particular tags from soup using python?
From below webpages I like to extract data:
https://www.ams.usda.gov/services/enforcement/organic/settlements https://www.ams.usda.gov/services/enforcement/organic/settlements-2023
"03/19/2025&...
0
votes
1
answer
83
views
ModuleNotFoundError: No module named 'bs4' but in pip list is already installed
in here try to install beautifulSoup using pip, but the module is not found,
I try to verify python path and pip on my computer here us the result
/Users/macbookairm2/Code/Dev/Fiverr/Scraping/project/...
- 823
0
votes
2
answers
75
views
Unable to get the proper data of La Liga Points Table from the FC Barcelona website using BS4
Im trying to extract the points table data from the https://www.fcbarcelona.com/en/football/first-team/standings website. I want to extract the data of the current table (24-25) but it is extracting ...
0
votes
2
answers
31
views
Find all "a" tags in multiple divs with same class with BeautifulSoup
I want to find all "a" elemnts in multiple divs with same class.
from bs4 import BeautifulSoup
links = soup.find_all("div", class_="va-columns").find_all("a")
...
1
vote
1
answer
34
views
How to get text in beautifulsoup as .innerText and not as .textContent in JS
I have an HTML file that contains text inside a p tag, something like this:
<body>
<p>Lorem ipsum dolor sit amet,
consectetur adipiscing elit.
Maecenas sed mi lacus.
...
- 63
1
vote
1
answer
52
views
Unable to produce the result containing the address I wish to obtain
I'm trying to create a script using the requests module and the BeautifulSoup library from this website that will do the following:
Select the Strata plan number button, input 11 in the input box, and ...
- 149
0
votes
0
answers
20
views
How to select the section HTML tag using beautifulsoup4 for web scraping [duplicate]
This is the link to the website I am trying to scrape data from: https://www.fotmob.com/leagues/47/stats/season/20720/players/goals/premier-league.
I want to select the section with class = 'css-...
0
votes
2
answers
150
views
Unable to parse the results from a webpage using the requests module
I've created a script to scrape the names of the products from this webpage using the requests module. When I run the script, I can see the status code is 200, but the script doesn't bring any results....
- 95
-1
votes
1
answer
145
views
Amazon Product Links Scraping Using BeautifulSoup and Request
I am scraping this Amazon page:
https://www.amazon.com/s?k=mercedes&crid=37ZCGOIJ0A8V4&sprefix=me%2Caps%2C1587&ref=nb_sb_noss_2
Here's my code:
import requests
from bs4 import ...
0
votes
1
answer
48
views
Trouble scraping a website address from a webpage using the requests module
I'm trying to scrape the website address of Yauatcha Riyadh from a webpage using the requests module, but I end up getting None. I can fetch the title and the phone number from that page, but I failed ...
- 164
1
vote
1
answer
52
views
How to scrape the accurate fields from HTML tables of varying lengths?
I'm trying to create a script to scrape a few fields from tables based on their headers. The problem is that all the tables are not of the same length, along with their headers.
Here are the HTML ...
- 164
1
vote
2
answers
126
views
Web Scraping with Python without pagination site
I scrape data from the website using Selenium and BS4 and save it to json file. Since there is no pagination structure, I use web driver with selenium, but before adding selenium, while my old code ...
- 25
0
votes
1
answer
49
views
How can I scrape the titles from each row of a table with gibberish elements?
I'm trying to scrape the tabular content from this webpage using the requests module and the BeautifulSoup library.
I've managed to get the HTML elements containing the table having some gibberish ...
- 164
2
votes
1
answer
5k
views
Python "Illegal instruction (core dumped)" when importing certain libraries (beautifulsoup4. yfinance)
I am using Python3.10 on Ubuntu 22.04.4, and I am trying to run code that I originally wrote on a Windows 11 machine. Whenever I run this script--main.py--it always stops at the import stages, and ...
- 274
0
votes
1
answer
66
views
Select all <table> elements without classes or ids with BeautifulSoup
I am trying to select all <table> elements on some web pages with BeautifulSoup. The table elements do not have specific classes or ids.
import bs4
import requests
def get_keycode_soup(url):
...
- 1,294