X
X
XenK2015-09-19 15:51:38
PHP
XenK, 2015-09-19 15:51:38

How to save the address of links on the site?

It is necessary to get all links on the first page of a certain type, for example: http://*.site.com . Next, follow these links and get others, etc. But within the site: site.com. How can this be done, and most importantly, on what?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
M
Mikhail Osher, 2015-09-19
@miraage

symfony dom crawler + guzzle.

S
sivabur, 2015-09-20
@sivabur

regular expressions (or html parsers for php) + curl.
But if the project is serious and has a lot of pages, and speed is important, then c++.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question