How to handle BigData?

Question

Python

Good day dear gentlemen. Can you please tell me the best way to process a large amount of data in a Ract application and backend on Falcon (python)? I'm thinking of making a completely API in python, and then taking data for the frontend from it.

Answer 1

no graph, and even more so a table on the screen, will not contain millions of values. even more than 100 is rare. You do not need to load all this and try to withdraw at once.
In order not to load more than necessary:
​​- filtering (for example, "data for today" or "for this person")
- pagination (next 50 records starting from 123849)
- aggregation (average income for each year over the past 10 years - you get 10 records in the answer)
- virtualized tables that render only what you need, and not all 100500 records that you fed it ( https://github.com/bvaughn/react-virtualized, google it further)
So that it does not slow down on the server:
- correct indexes
- Get the most out of SQL
- competent organization of data / work with them (if possible)

Answer 2

data.teg = ( !parseInt(data.teg) ? 'Нет' : 'Да' )
Work example: