N
N
Nikolay2015-01-24 18:25:30
Network administration
Nikolay, 2015-01-24 18:25:30

Thousands of left requests in the logs to the pages of the site. Where, how to fight?

On a shared hosting in the logs, there are several tens of thousands of requests per day to different pages of the online store. As a result, an increased load is created and the hosting sends letters that will turn it off. Usually it is kept almost at the limit of resources. But if + a lot of visitors come, it turns out that they will immediately turn me off.
site.ru 85.10.200.99 - - [24/Jan/2015:16:25:14 +0300] "GET /orders_export/?uid=8314ebe26221a9437b67f9030717be70 HTTP/1.1" 403 324 " site.ru " "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0)"
and the /orders_export/ page is not used at all on
site.ru 183.252.52.181 - - [24/Jan/2015:16:25:55 +0300] "GET /page address store/ HTTP/1.1" 200 43381 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
site.ru 183.252.52.181 - - [24/Jan/2015:16:25:58 +0300] "POST /store page address/ HTTP/1.1" 200 43774 " http://site.ru/page address /" " Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
What could it be? First time I've encountered this.
How to deal with it?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
M
Multigame, 2015-01-24
@Multigame

Perhaps...
You are using a CMS that may have a module available at the requested path. There are heaps of spider-grabbers roaming the Internet, ripping off information from sites for various purposes. Often, sites based on cms-systems become the primary goal of such systems.
Regarding dealing with this... Probably your system handles such requests fully (web server + interpreter + database). If this is true, then you can use .htaccess (if the server is apache) to cut off requests to non-existent yurls on a static page, or immediately return an error ... This removes the load from the database and the interpreter.
If requests are processed only by a web server, then jail daemons such as fail2ban can be used. But for most hosts this won't work because fail2ban can't be installed.
In general, the entire commentary is a pitchfork in the water, given that the information provided is clearly not enough ...

N
Nikolay, 2015-01-24
@Nikolaos

HostCMS.ru installed.
"there may be a module available at the requested path." Which way?
There are 400 pages on the site and everything goes one GET, and the second POST request. and periodically request /orders_export/ which is set to 403 error.
How to chop urls by .htaccess if all of them are valid pages. There are no requests for non-existent ones, only for those that are on the site.
"In general, the entire commentary is a pitchfork in the water, given that the information provided is clearly not enough ..." And what is not enough?

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question