Answer the question
In order to leave comments, you need to log in
How to scrape all links from someone else's site?
I need to parse all text external links from someone else's site.
That is, you need to run a process that will bypass all the pages of the site, and write out all the found external non-clickable links.
The result is preferably in the form
of the url of the site page where the link was found -> found link
Please tell me if there are ready-made programs for this or what other options to do this?
Answer the question
In order to leave comments, you need to log in
If you have programming skills, then the Symfony crawler will easily cope with this task. A simple script will be.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question