Can two consumers read from the same topic in Kafka?

Question

Apache HTTP Server

Can two consumers read from the same topic? In this case, it is necessary that both of them process each message of the topic. To do this, do they need to set the same or different consumer_group_id?

Answer 1

They must be in different groups because a consumer group is a single logical consumer that consists of one or more physical consumers. All partitions of all topics to which the group is subscribed are divided equally among the members of the group. Therefore, if you need not to divide, but to duplicate, you need several groups.