How to parse data and load it into the project?

Question

Parsing

Hello, tell me where it is better to save the results of parsing and in general am I on the right track?
I think it's best when parsing to parse everything as it is, so that when requirements change, you can do anything with this data, and not parse everything again. And then the loader of this data must separately load this data into the project. I think it's better to save this raw data (decided that mongo would be the best option). Also what is the best way to do the download itself? Do everything in one project inseparably or take some kind of lightweight framework and do everything on it, both parsing and loading .. In general, tell me how it's done correctly

Answer 1

django + scrapy run cron

Answer 2

crypt? if the data does not become obsolete over time (for example, rates), keep it with you and give it out when you need it