Bypass ban when parsing netpeak spider?

Question

Parsing

How to get around the ban on the site when parsing goods using netpeak spider. I set a working proxy but still banned almost immediately.
Or advise a program for parsing goods in a csv file)

Answer 1

Most often, sites use protection from crawling, which is expressed in limiting the number of requests per unit of time. Apparently, you just exhausted this limit.
A good solution in this case would be to use a proxy list + reduce the number of requests. This can be done by reducing the number of scan threads (Settings → General), you can also set a small delay between requests.
If the site uses this type of protection, then this should help.
If it doesn't help or you have any questions, you can always contact technical support on our website netpeaksoftware.com. We will respond within a few minutes.