Code or math?

Question

Python

Are there any ways to find out what the error is, in the neural network training code or in the mathematical model of this very training?

Answer 1

Let's still strictly formalize the question.
"in the learning code of the neural network or the mathematical model of this very learning" - it's somehow completely fuzzy. Suppose you meant
"mathematical learning model" =="network learning algorithm"
"learning code" == "software implementation of this very algorithm".
Then the task gets a strict formulation: " We have programmed some learning process. The result is not what we expect. Where is the error - in the algorithm or in the code" .
And if this is so, then in such a formulation, although the problem cannot be solved with absolute accuracy, it is clear what needs to be done in order to give an answer. By and large, it is now no different from the usual task solved at the testing stage in the development of any software product - from toys to websites.
There are two solutions.
Analytical:
1. Deep analysis of the algorithm (i.e. once again we study what is written in the book where we got it from, because there are mistakes in books).
1. Traditional code review.
(Well, as they joked here - you can put both of these tasks on the teacher :-). ).
Experimental:
1. Find and clearly write down the algorithm.
2. We give it to be programmed by two, three .... the more, the better ... programmers. We get many implementations of the same algorithm.
3. Run the network learning process through each implementation. We compare the results with the expected ones.
4. If the implementations gave results different from expected, but coinciding with each other, look for errors in the algorithm. If the implementations gave results different from expected, but different from each other - look for errors in the code.
But there are no simple, "bookish" solutions to this problem.

Answer 2

Q : Are there any ways to find out if the error is in the code for solving the quadratic equation or in the formula that the code implements?
A : Submit the code to the teacher for verification.

Answer 3

The mistake is always in what comes first.
And primary - mat. model.
Therefore, look for the reason for incorrect learning in the mathematical model (formulas).