Raspberry Pi - sound analysis and LED control?

Question

Raspberry Pi

Hello. I plan to make an Ambilight system based on Raspberry Pi and controllable LEDs. There will be an analysis of the hdmi stream with conversion to AV. Due to the fact that the AV stream enters the raspberry through the USB Video Grabber through the tulips - in fact, only the video signal tulip is needed there, the sound is not important for the backlight, but! if two tulips of sound remain unsatisfactory, then the idea arose to connect the output from the amplifier to them in parallel and analyze the sound already when I listen to music and, for example, smoothly change the brightness of the LEDs depending on the dB of sound, well, or on other characteristics, the main thing is that only in one degrees of freedom - brightness.
Does anyone have experience in analyzing sound and in which direction to dig, since I don’t understand raspberries yet, I’ll do ambilight according to the Germans’ guides.

Answer 1

Well sound analysis is usually Fourier decomposition and everything around it.
Done using the Cooley-Tukey algorithm