How to use web clawler in python code?

Question

Python

I found a good web-crawler - scarpy, only it is used as a daemon, as I understand it, and saves the results to files.

I read the docs, did not find any hints.
The purpose of parsing is this - the user passes the url, I do manipulations through python and send this url to scrapy for processing, get a response and give it to the user.
That is, remove the unnecessary chain with the launch of the process and output to a file, request-response in the python code.

Thanks

Answer 1

Who cares - I dug up material on the topic , I'm digging further