What areas of mathematics do you need to know in order to understand and develop algorithms based on neural networks?

Question

Mathematics

I constantly read articles on Habré about learning machines and neural networks, but because of ignorance of the mat. parts have problems understanding the algorithms. I would like to learn theory, but I do not know where to start.

Answer 1

I will add: as well as linear algebra, mat. analysis, ter.ver, combinatorics. For example, you can smoke the ShAD list .

Answer 2

Statistics and most of discrete mathematics (English wiki due to quite a good set of subsections).