S
S
shearlocktm2015-01-14 10:32:24
Search Engine Optimization
shearlocktm, 2015-01-14 10:32:24

How to close a forum from indexing leaving only a few topics open for robots?

There is a site with an old and very cluttered forum completely closed from indexing, in which several topics are of value. It is closed by means of Disallow: /forum/ in Robots.txt How can these topics be opened for robots? Will it work by adding Allow: /forum/goodthemes/ to robots? Thanks in advance.

Answer the question

In order to leave comments, you need to log in

1 answer(s)
S
shearlocktm, 2015-01-14
@shearlocktm

Solved the problem like this.
Because Google and Yandex are friends with the Allow directive, do the following.
We close from indexing all pages starting with forum:
Disallow: /forum/
But we allow indexing pages starting with forum/viewforum and /forum/viewtopic:
Allow: /forum/viewforum
Allow: /forum/viewtopic
Accordingly, pages like /forum/ will be indexed viewforum.php&f=31 and the like.
There is quite a bit of information on the subject here .
If someone can add or provide alternative solutions, I will be grateful.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question