V
V
Vlad2017-03-15 16:38:31
PHP
Vlad, 2017-03-15 16:38:31

How to scrape all links from someone else's site?

I need to parse all text external links from someone else's site.
That is, you need to run a process that will bypass all the pages of the site, and write out all the found external non-clickable links.
The result is preferably in the form
of the url of the site page where the link was found -> found link
Please tell me if there are ready-made programs for this or what other options to do this?

Answer the question

In order to leave comments, you need to log in

3 answer(s)
S
Stepan, 2017-03-15
@steff

Maybe this will work: www.scripts.morshed-alam.com/url-scraper-php

E
Evgeny Svirsky, 2017-03-15
@e_svirsky

If you have programming skills, then the Symfony crawler will easily cope with this task. A simple script will be.

F
f9k56, 2017-03-16
@f9k56

I would do so. Wget-volume pulled the site to LAN, then processed the Content Downloader.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question