All Questions
160 questions
0
votes
1
answer
70
views
Python Requests GET with Proxy - HTTPS scheme returns expected result but HTTP returns header
When setting any URL to use HTTPS as the scheme (i.e., https://), I get my desired response (i.e., page source), but any http url (i.e., http://) fails or I receive a header and I don't understand why ...
- 73
0
votes
0
answers
36
views
Selenium webdriver returns ERR_CONNECTION_RESET for reachable webpage
I am trying to setup a selenium webscraper in jupyter notebook on Azure Databricks (on a linux cluster). I am able to set up the service, options, and driver without issue. When I use driver.get(url) ...
2
votes
1
answer
128
views
How can I get around an unresolved hostname or unrecognized name error using HTTP(S) in java or python?
I a trying to access a website's information programmatically, but on both Java and Python it is unable to resolve a hostname. If I specify the IP address, it changes the error to ...
- 402
2
votes
0
answers
54
views
Some HTTP to HTTPS redirections were not done using Python Requests
When visiting http://www.google.com in a browser located in the US, it should be redirected to https://www.google.com. However, this does not appear to work when using Python Requests, as demonstrated ...
- 110
0
votes
0
answers
29
views
How to get redirected url in Python?
I have a list of url to songs' tiktok page url in the form of f'https://www.tiktok.com/music/-{songid}'. If I enter it in my browser, I'll be redirected to a page with a longer url, which is what I ...
0
votes
1
answer
207
views
HTTPS GET with API Bearer Token: working with cURL but not with Python requests.get
When I launch the following cURL command on a https URL with an API token, I get the expected response (a list of files in my storage): curl -H "Authorization: Bearer <TOKEN>" "...
- 13k
0
votes
1
answer
156
views
python requests: connection problems
i´m pretty new in Python programming.
I have python3 and i installed requests via pip.
I cant connect to any site with .get...
Is it a firewall or some connection problems ? I´m clueless
my code:
...
- 3
0
votes
0
answers
2k
views
SSL: CERTIFICATE_VERIFY_FAILED error for httpx but works for requests
I am switching over some code originally hitting an API through http to now use https. The code is using httpx to hit the API. When trying to make a request I am getting
ssl.SSLCertVerificationError: [...
- 1
0
votes
1
answer
293
views
ConnectionResetError with Python requests and urllib libraries when accessing specific URL
I'm encountering a ConnectionResetError when attempting to access a specific URL using both Python requests and urllib libraries. Despite providing appropriate headers, the connection is being ...
- 13
0
votes
1
answer
4k
views
How to fix "ProxyError: Cannot connect to proxy, Tunnel connection failed: 403 Forbidden" when making a request in Python using requests library?
I am working on my pet project and have chosen www.pythonanywhere.com for hosting
to implement some functionality, I need to take information from sites
but when I execute the following code
import ...
- 11
0
votes
0
answers
103
views
Python HTTP request timing out on AWS Lambda
The line
response = requests.get('https:://url_for_my_endpoint.com', verify=False)
times out in my AWS lambda. I can access other endpoints, e.g.
response = requests.get('https://www.google.com/')
...
- 83
0
votes
0
answers
190
views
PyCharm HTTPS Requests problem. Cannot see any requests results
I have a problem with my PyCharm. It doesn't show me any requests results when I run my program.
The only thing I get is 'Process finished with exit code 0', but from what I saw from other guides it ...
0
votes
2
answers
84
views
Fetch csv file from https using python [duplicate]
This is a fairly simple problem:
Fetch a csv file from an https url using python. The only allowed source to get it is:
https://query1.finance.yahoo.com/v7/finance/download/BTC-USD?period1=1535760000&...
- 1
0
votes
1
answer
121
views
python 3 script cannot access a domain on the same host
I have 2 python apps:
Backend server, processes requests. It works via FastAPI + gunicorn (as a python library). I run it like this: gunicorn main:app -b MINE_IP:8000 -c gunicorn_config.py --worker-...
- 1
3
votes
0
answers
396
views
Twitter website gives a different response when sending a request using python-requests
When I send a get requests to https://twitter.com/ using Burp Suite or CUrl, I get HTTP 302 with following body: Found. Redirecting to /i/flow/login?redirect_after_login=%2F. However, when I make the ...
- 31