Answer the question
In order to leave comments, you need to log in
Are there standards for loading and processing data into an application?
Tell me, are there any standards for processing uploaded files?
For example, we load a large *.csv or *.xls file into the application, which describes the properties of a certain number of loaded objects.
The download does not go through, there may be several reasons for this.
From personal experience, when implementing loaders, the following is done:
- logging on loading and updating
- human-readable answers from the application what, in which line, which property does not meet expectations.
- check for the presence of an object in the database (if the loader should only update the properties)
- check for the participation of the property in the update (in case they want to update the file, say the id of the entry in the database)
- Checking if the property is required to be filled in (in case the field in the database cannot be null)
- Checking the types of properties against the types in the database
- Type conversion methods (if applicable)
What standard checks should be performed at the time of loading?
Maybe there is literature that describes such practices?
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question