Answer the question
In order to leave comments, you need to log in
How to determine who is parsing my site?
Briefly. According to the graphs, I see that the outgoing traffic on the site has become very large. At the same time, Google Analytics shows the same traffic that goes. It looks like someone is scraping my site. MySQL keeps crashing. I could write a script now, calculate the IP address, but I'm too lazy. Are there any utilities/programs to discover the IP of who is doing this?
Answer the question
In order to leave comments, you need to log in
Here you can find an example https://rtcamp.com/tutorials/nginx/log-parsing/
It is better to configure MySQL so that it does not fall. And make a light version of the site for text browsers and robots.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question