How to collect the maximum possible number of addresses of sites of the desired subject?

Question

Crawling

To me not for spam, but for collecting texts.
I'm looking for some software like a spider.
I understand that the sites themselves have links to other sites, but it's probably best to make requests to a search engine.
Tell me, please, in which direction to dig?