Answer the question
In order to leave comments, you need to log in
Thousands of left requests in the logs to the pages of the site. Where, how to fight?
On a shared hosting in the logs, there are several tens of thousands of requests per day to different pages of the online store. As a result, an increased load is created and the hosting sends letters that will turn it off. Usually it is kept almost at the limit of resources. But if + a lot of visitors come, it turns out that they will immediately turn me off.
site.ru 85.10.200.99 - - [24/Jan/2015:16:25:14 +0300] "GET /orders_export/?uid=8314ebe26221a9437b67f9030717be70 HTTP/1.1" 403 324 " site.ru " "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0)"
and the /orders_export/ page is not used at all on
site.ru 183.252.52.181 - - [24/Jan/2015:16:25:55 +0300] "GET /page address store/ HTTP/1.1" 200 43381 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
site.ru 183.252.52.181 - - [24/Jan/2015:16:25:58 +0300] "POST /store page address/ HTTP/1.1" 200 43774 " http://site.ru/page address /" " Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
What could it be? First time I've encountered this.
How to deal with it?
Answer the question
In order to leave comments, you need to log in
Perhaps...
You are using a CMS that may have a module available at the requested path. There are heaps of spider-grabbers roaming the Internet, ripping off information from sites for various purposes. Often, sites based on cms-systems become the primary goal of such systems.
Regarding dealing with this... Probably your system handles such requests fully (web server + interpreter + database). If this is true, then you can use .htaccess (if the server is apache) to cut off requests to non-existent yurls on a static page, or immediately return an error ... This removes the load from the database and the interpreter.
If requests are processed only by a web server, then jail daemons such as fail2ban can be used. But for most hosts this won't work because fail2ban can't be installed.
In general, the entire commentary is a pitchfork in the water, given that the information provided is clearly not enough ...
HostCMS.ru installed.
"there may be a module available at the requested path." Which way?
There are 400 pages on the site and everything goes one GET, and the second POST request. and periodically request /orders_export/ which is set to 403 error.
How to chop urls by .htaccess if all of them are valid pages. There are no requests for non-existent ones, only for those that are on the site.
"In general, the entire commentary is a pitchfork in the water, given that the information provided is clearly not enough ..." And what is not enough?
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question