D
D
Dmitry Karmazin2014-07-07 11:54:06
Yandex
Dmitry Karmazin, 2014-07-07 11:54:06

How to count the number of pages on a website?

There was a service at webmaster.yandex.ua/check.xml , which very accurately counted the number of pages on the site.
The Google option site: website.com I know, but it's less accurate. For example , Google finds 575 pages on biopromin.info , but I know that there are 488 (calculated using NeoWatcher)
Bing generally finds 1900 pages.
1. Is it possible to use the old Yandex service?
2. What other services are fast and accurate?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
B
barkalov, 2014-07-07
@barkalov

Curl + simple parser for pulling urls from html. And curl recursively again.
Or phantom.js instead of curl, then even links generated by scripts, ajaxes and other client-side dynamics will be considered.

N
Nikolai Pinevich, 2017-08-21
@Afres

If the site map is correctly configured on the site, then you can use this service https://webmaster.yandex.ru/tools/sitemap/
And insert a link to your site http://www.your_site.ru/sitemap.xml

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question