What is the best way to process volumetric data from an external service?

Question

Django

Good afternoon.
I'm trying to make several information pages with reports for the service, the data from which I get via the API (for example, a list of users and their properties from an external service). And it turns out that to implement any function (data search, output pagination, etc.), you have to pull the API every time and get a rather voluminous piece of data (the request is about 10-15 seconds and will increase over time), which rather slows down the work with site.
It comes to mind when entering the site to pull the data once, push it into the database and then work with it. But here there are problems with deleting data from the database after the work with them is completed (what will be the event for deleting this data?).
Can you tell me if there are other ways to solve this problem?

Answer 1

I would attach to the session.

Answer 2

Just cache the data.