Do you need a service to find broken links on the site?

Question

Software testing

I recently started working on a project that is full of broken links. The worst thing is that if you change the routes a little (a project on rails), then some links start working, and some will definitely fall off. There are no tests and it is not very clear how to test the performance of links at least on the main page.

I wrote a small script that parses the page for all links and crawls them (asynchronously), generating a list of broken links as output: Check pages status with em-synchrony crawler .

And then it dawned on me - why not make a service that, after each deployment, would itself go through the necessary pages (either all, or from the whitelist, for example, news/* goes through all the news) and send a beautiful email with the necessary statistics - how many links in total, what broken, response time.

Do you need such a service and what else would you like to see in it?

Answer 1

There is also www.brokenlinkcheck.com/

Answer 2

wget --spider -o wget.log -e robots=off --wait 1 -r -p http://site.url

Answer 3

By the way, who needs such a service for free even now, I advise you to look at the skipfish utility from Google. She not only looks for broken links, but also looks for vulnerabilities, and also stress tests the application at the same time. What could be better?

Answer 4

Xenu's Link Sleuth

Answer 5

The W3C also has a Link Checker .

Answer 6

github.com/cballou/caterpillar

Answer 7

on Win used Xenu's Link Sleuth
on MacOs Integrity