How to authorize in a corporate environment through a script?

Question

Python

I need to download several pages on the corporate website for analysis, but I can't log in. The server always responds with 401. I
use a standard request:

r = requests.get('https://example.com', auth=('user', 'pass'))

How to log in correctly?

Answer 1

How to log in correctly?

The answer to this question is known only to the one who wrote this site.
Open the Chrome console, look in the Network panel for requests (you need to set the "Preserve log" flag) and make a sequence: what, where and in what order you need to send in order to get the coveted cookie.

Answer 2

from requests.auth import HTTPBasicAuth

r = requests.post('https://example.com, auth=HTTPBasicAuth('user', 'pass'))

There are different types of authorization. Try to look at the page headers which authorization you need to use.

Answer 3

Watch outgoing / incoming requests with a browser, and in the script in the headers form the same ones.
For example, the User-Agent can be checked on the server side