About htaccess

Question

htaccess

Recently, due to my oversight / ignorance, I banned the Google robot.
I just don't quite understand how it happened.
I don’t like it when I don’t understand “why so”, so I ask those present here.

Added
deny from 77.168.252.130 #javabot line to htaccess

And this ip is not Googlebot's ip . As I already understood, comments (#) must start on a new line. Those. I do this: #javabot deny from 77.168.252.130 and Googlebot immediately appears in the logs (with a different IP address) So, the question is, what happened when there was a line in htaccess



deny from 77.168.252.130 #javabot ????

No errors popped up.
A small drawdown in attendance was fully explained by the holidays.

Answer 1

$ curl ifconfig.me
X.X.X.231
$ ssh web 'echo "deny from X.X.X.230 #javabot" >> /var/www/site.com/.htaccess'
$ wget -O /dev/null site.com --user-agent="javabot"
HTTP request sent, awaiting response... 200 OK
2011-11-09 12:34:00 (1.22 MB/s) - `/dev/null' saved [2168/2168]
$ wget -O /dev/null site.com --user-agent="Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
HTTP request sent, awaiting response... 200 OK
2011-11-09 12:35:05 (621 KB/s) - `/dev/null' saved [2168/2168]
If I write my ip there in one line with a comment, then everything will still work fine.

Answer 2

I think it has nothing to do with it. if a googlebot came to you, it would get 403 and log it. and you say you didn't show up at all. I didn't want to, that's all.

Answer 3

Yes, the whole joke seems to be that it DOES NOT matter what ip is written
Write
deny from XXXX #bla-bla-bla - no Googlebot
Write
#bla-bla-bla
deny from XXXX - no Googlebot
(x - any probably)
Satan, damn it.