How to process data in goroutines in batches?

Question

go

Hello! I have never written parallel computing before. Faced with the task: there is a huge array of links. Let's say 10k pieces. They need to be processed in batches, at least 10 each. In fact, this is a parser. I read a lot about goroutines, but did not quite understand how to make them process such a large array in portions. Thanks in advance for your replies.

Answer 1

There is a Worker Pool pattern, you can see an example here: https://gobyexample.com/worker-pools

Answer 2

10k is not much, you can consider a simple package for this https://github.com/alitto/pond