Answer the question
In order to leave comments, you need to log in
How to disable redirect in Scrapy?
I'm trying to crawl a site in the en domain, but when parsing, the request is redirected to the ru zone, and the pages of the site in Russian are collected accordingly. Tried to put
custom_settings = {
'REDIRECT_ENABLED': False
}
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question