How to organize parsing and autofilling on WordPress?

Question

Python

There is a site (WordPress) , it needs to be updated daily.
The data is taken from another site , ie. the program should parse them (data), format them and upload them to the recipient site.
Previously, I wrote only simple crawlers and selenium bots. Those. In detail, I roughly understand how what should happen.
As I see it : I am writing a control module that runs once every 24 hours at 4:00. It imports scrapy spider modules, runs them in the thread pool, and then generates a file with selenium, uploads them to WordPress through the admin panel.
Questions .
1. How good is this solution? Are there any pitfalls? Advise what?
2. How can this problem be solved differently?

Answer 1

Either write imports to the database right away in the parser (but you have to deal with the structure), or you can write, for example, to a file and use some kind of import plugin in WP, of which there are a lot.