Answer the question
In order to leave comments, you need to log in
Where to find or from what is it easier to cut a PHP crawler library with 3 simple functions?
Prompt a library with 3 functions - to index a page, get a list of pages for indexing and get the result of a query.
Without PCNTL, semaphores and other special requirements (that is, without the loops themselves, which endlessly run the indexer). MySQL is of course needed.
Everything I found doesn't work:
phpcrawl.cuab.de :
In order to run phpcrawl in multi-process-mode, some additional requirements are needed:
The multi-process mode only works on unix-based systems (linux)
Scripts using the crawler in multi-process-mode have to be run from the commandline (PHP cli)
The PCNTL-extension for php (process control) has to be installed and activated.
The SEMAPHORE-extension for php has to be installed and activated.
The POSIX-extension for php has to be installed and activated.
The PDO-extension together with the SQLite-driver (PDO_SQLITE) has to be installed and activated.
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question