Answer the question
In order to leave comments, you need to log in
How to count the number of pages on a website?
There was a service at webmaster.yandex.ua/check.xml , which very accurately counted the number of pages on the site.
The Google option site: website.com I know, but it's less accurate. For example , Google finds 575 pages on biopromin.info , but I know that there are 488 (calculated using NeoWatcher)
Bing generally finds 1900 pages.
1. Is it possible to use the old Yandex service?
2. What other services are fast and accurate?
Answer the question
In order to leave comments, you need to log in
Curl + simple parser for pulling urls from html. And curl recursively again.
Or phantom.js instead of curl, then even links generated by scripts, ajaxes and other client-side dynamics will be considered.
If the site map is correctly configured on the site, then you can use this service https://webmaster.yandex.ru/tools/sitemap/
And insert a link to your site http://www.your_site.ru/sitemap.xml
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question