E
E
Edward2018-01-04 16:18:06
Google
Edward, 2018-01-04 16:18:06

How to check many sites for the presence of words?

Good afternoon. Can you please tell me how it is possible to check 16,000 sites for the presence of certain words on the main page? Automated. That is, for the robot to go to the main page of the site, check for the presence of the desired word, if found, then mark this site, then the next site, etc.
In general, the task is to find in the list of sites those sites that contain the desired word.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
K
Ken Jee, 2018-01-04
@Machez

Write a robot, for example in php. Which will run through the database of your addresses, read and analyze their contents. How about here.

A
Alexander Pozharsky, 2018-01-04
@alex4321

curl $HOMEPAGE$ | grep $KEYWORD
echo $?

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question