How to disable facebook crawler?

S

Skinner2020-08-29 19:23:52

Facebook

Skinner, 2020-08-29 19:23:52

For a month now, the site has been receiving anomalous traffic from Facebook from the USA (I attach the screenshot), which loads the server, spoils the GA statistics. After analyzing the traffic, I found a proxy FB server and when they are blocked, you can’t share a link on FB so that the photo and text in the preview are pulled up. So banning is not an option. Tell me, pliz, who faced? What to do?

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

P

Pavel Chesnokov, 2020-09-01
@cesnokov

I assume that you have poorly configured tags for robots, so they go to you every day.

<meta property="article:published_time" content="2020-08-01T12:00:00+00:00">
<meta property="article:modified_time" content="2020-08-01T12:00:00+00:00">
<meta property="og:updated_time" content="2020-08-01T12:00:00+00:00">
<meta name="revisit-after" content="14 days">