How to force Yandex to correctly index an Ajax site that uses the HTML5 URL mode?

N

navar2014-11-17 00:41:42

JavaScript

navar, 2014-11-17 00:41:42

There is a website that works using ajax technology.
The site has, for example, the following URL:
www.example.com/blog/

When the robot accesses this URL, a page with the HTML tag is returned . Also, this page does not contain any content within itself. Its content looks something like this:<meta name="fragment" content="!" />

...
  <body>
    <div id="content"></div>
  </body>
</html>

Next, Yandex goes to www.example.com/blog/?_escaped_fragment_= and receives a fully formed HTML version of the page, but without the tag . But here comes the difficulty. When a page appears in Yandex search results, it is already located at www.example.com/blog/#! The problem is that such pages either end up in the search results, then disappear from it with the Yandex webmaster's note "The page is crawled by a robot, but is not in the search because it duplicates the pages already on your site." The "Pages in search" graph of Yandex-master looks like this: Tech. Yandex support gave the following answer:<meta name="fragment" content="!" />

"Unfortunately, this display of page addresses is due to problems on our part. Our specialists are already aware of their existence, we hope that the data in the search will be updated soon."

It is clear that this behavior of Yandex is due to the fact that initially Ajax sites were supposed to use URLs like www.example.com#!/blog/. Then the Yandex robot would access the page www.example.com?_escaped_fragment_=/blog/ and the page with the correct address www.example.com#!/blog/ would get into the search results. But I really don't want to have such ugly addresses on the site.

Is there any existing solution to the problem of dropping pages of Ajax sites from Yandex search results?

I really don't want to:
1. Return to the HTML version of the site without Ajax.
2. Go to addressing pages like www.example.com#!/blog/

Reply

Answer the question

In order to leave comments, you need to log in

8 answer(s)

V

Viktor Krasnov, 2017-01-10
@katzo

Does anyone know if anything has changed since 2014? The same question interests.

I

Igor Tarasov, 2014-11-20
@itsoft

When AJAX had just appeared, and this was probably almost 10 years ago, everyone rushed to use it where it was necessary and not necessary. But I immediately said and constantly repeat that the site should be able to send a link to the page to a friend.
This defines the site. It has pages and each page has its own URL. Pages will be indexed. And links to them will be distributed throughout the Internet.
AJAX should be used to load some non-essential things that do not need their own URL on the Internet. Or for applications like a game of tanks, where the URL does not make any sense and it does not exist, because. there is full dynamics and there is nothing to refer to.

A

Alexander, 2014-11-17
Madzhugin @Suntechnic

Crazy idea: what if all the content of www.example.com/blog/ is wrapped in

P

Petrusha Ukropov, 2014-11-17
@artishok

Forget about anchors already, google history api

N

NIKNNN, 2014-11-22
@NIKNNN

No way ... until you get rid of it there will be no promotion effect) Mark my words.

P

Pavel Volintsev, 2015-08-23
@copist

Render pages through prerender.io
Article on this topic: https://scotch.io/tutorials/angularjs-seo-with-pre...
But the approach is the same for any sites where part of the content is generated via javascript

Y

Yury Egorenkov, 2016-11-15
@yury_egorenkov

Try renderjs.io

L

lipinart, 2017-09-11
@lipinart

And still wondering what to do with SPA-sites?