How to make an analogue of the backlink service to the site ahrefs example?

P

Pavel Brunki2014-12-09 16:24:24

Programming

Pavel Brunki, 2014-12-09 16:24:24

How to make an analogue of the ahrefs service
1. The search robot has already been written.
1.1. how to make it so that it is not banned
that it will be needed.
Thanks

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

V

Vitaly Yakovenko, 2014-12-12
@Xazzzi

Masquerading as googlebot/yandex crawler. There are hardly any fools who have banned search bots at home.