T
T
titronium2014-06-09 10:17:55
linux
titronium, 2014-06-09 10:17:55

How to determine who is parsing my site?

Briefly. According to the graphs, I see that the outgoing traffic on the site has become very large. At the same time, Google Analytics shows the same traffic that goes. It looks like someone is scraping my site. MySQL keeps crashing. I could write a script now, calculate the IP address, but I'm too lazy. Are there any utilities/programs to discover the IP of who is doing this?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
M
Mikhail Alekseev, 2014-06-09
@titronium

Here you can find an example https://rtcamp.com/tutorials/nginx/log-parsing/

J
Jock Tanner, 2014-06-19
@Tanner

It is better to configure MySQL so that it does not fall. And make a light version of the site for text browsers and robots.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question