How to highlight bots in access.log and send them to fail2ban?

Question

Nginx

Hello!
There are robots that frankly parse the project, and there are conscientious users who generate a large number of requests. limit_req is not suitable, because more than one user can have one IP, and even one user at some single moments of time can be overactive. There are also addresses to which many requests are allowed.
Robots tend to iterate over IDs, such as /page/1, ..., /page/1000.
Also, a normal person will not request index.php 1000 times per minute.
Of course, robots can be detected manually, but I would like to automate this.
Share your experience. Thank you!