Z
Z
Zakhar Shaikov2018-10-30 11:30:17
data mining
Zakhar Shaikov, 2018-10-30 11:30:17

Techniques and methods for analyzing transformed data?

What statistical methods and ready-made tests to maximally and fully recognize hidden patterns and dependencies in tabular data?
An example of the studied results is attached in the photo.

spoiler
24003803_s.png

Each line is a separate result of the program.
More than 1 million such lines are planned to be processed and analyzed for relationships.
I emphasize the methods and techniques of analysis for the type of tabular data presented by me !!!
Here are the technical details of the question

1) Columns ( Start date ) and ( End date ) indicate the start and end point of the measurement (Tests)
Each row and all its components is a test at the algorithm level (Computation Block)
2) The third column indicates the serial number of the measurement ( Block ) during the tests. When forming the general population, all measurements are performed in order of priority and at the same time create a table with Blocks, the results and the structure of which directly depends on the structure or combination of the previous (blocks in front of it)
3) The fourth specifies the number of the final selection of block sequences
4) The columns of "weights" of functions conversions ( 1,2,3,5,8,13,21,34,R )
They point to one of the 2 possible nominative values ​​of the element of Block
V - l
. Also, each column of function weights has numerical values ​​assigned to it during the measurement.
Therefore, the 9 columns of the block have two qualities at the same time.
5) Rev-I is a block parameter assigned by the block time series calculation method based on its random structure. 6) The last three columns indicate the overall result of the block, which in turn consists of the nominal and numerical results of the “weights” of the functions. 7) A string combination of the results of function weights creates an "essence" of which there cannot be more than 512 pieces according to combinatorial laws.
The meaning and objectives of the analysis of the results in the detection of factors manifested in the elements of the block influencing and associated with the subsequent onset of one or another measurement result (Block-row) results of Blocks (measurements) going next in the experiment - research!?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
D
dmshar, 2018-10-30
@Singularnost2045

The choice of data analysis method depends on the goals that the researcher sets for himself - in the first place.
To such a general question - " recognize hidden patterns and dependencies in tabular data as much as possible and in full " - only a general answer can be given - by any methods of regression, classification, cluster, factor analysis.
" Ready-made tests " - probably means "libraries for data analysis". With your small amounts of data, any can also fit. From EXCEL or SPSS scikit-learn to scikit-learn or any libraries based on artificial neural networks.
In general - if you want specific answers - detail the question.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question