apache-kafka - Kafka : Continuously getting FETCH_SESSION_ID_NOT_FOUND

标签 apache-kafka

我不断收到FETCH_SESSION_ID_NOT_FOUND。我不确定为什么会这样。任何人都可以在这里取悦我,这是什么问题,对消费者和经纪人的影响是什么?

Kafka服务器日志:

INFO [2019-10-18 12:09:00,709] [ReplicaFetcherThread-1-8][] org.apache.kafka.clients.FetchSessionHandler - [ReplicaFetcher replicaId=6, leaderId=8, fetcherId=1] Node 8 was unable to process the fetch request with (sessionId=258818904, epoch=2233): FETCH_SESSION_ID_NOT_FOUND.
 INFO [2019-10-18 12:09:01,078] [ReplicaFetcherThread-44-10][] org.apache.kafka.clients.FetchSessionHandler - [ReplicaFetcher replicaId=6, leaderId=10, fetcherId=44] Node 10 was unable to process the fetch request with (sessionId=518415741, epoch=4416): FETCH_SESSION_ID_NOT_FOUND.
 INFO [2019-10-18 12:09:01,890] [ReplicaFetcherThread-32-9][] org.apache.kafka.clients.FetchSessionHandler - [ReplicaFetcher replicaId=6, leaderId=9, fetcherId=32] Node 9 was unable to process the fetch request with (sessionId=418200413, epoch=3634): FETCH_SESSION_ID_NOT_FOUND.

卡夫卡消费者日志:
12:29:58,936 INFO  [FetchSessionHandler:383] [Consumer clientId=bannerGroupMap#87e2af7cf742#test, groupId=bannerGroupMap#87e2af7cf742#test] Node 8 was unable to process the fetch request with (sessionId=1368981303, epoch=60): FETCH_SESSION_ID_NOT_FOUND.
12:29:58,937 INFO  [FetchSessionHandler:383] [Consumer clientId=bannerGroupMap#87e2af7cf742#test, groupId=bannerGroupMap#87e2af7cf742#test] Node 3 was unable to process the fetch request with (sessionId=1521862194, epoch=59): FETCH_SESSION_ID_NOT_FOUND.
12:29:59,939 INFO  [FetchSessionHandler:383] [Consumer clientId=zoneGroupMap#87e2af7cf742#test, groupId=zoneGroupMap#87e2af7cf742#test] Node 7 was unable to process the fetch request with (sessionId=868804875, epoch=58): FETCH_SESSION_ID_NOT_FOUND.
12:30:06,952 INFO  [FetchSessionHandler:383] [Consumer clientId=creativeMap#87e2af7cf742#test, groupId=creativeMap#87e2af7cf742#test] Node 3 was unable to process the fetch request with (sessionId=1135396084, epoch=58): FETCH_SESSION_ID_NOT_FOUND.
12:30:12,965 INFO  [FetchSessionHandler:383] [Consumer clientId=creativeMap#87e2af7cf742#test, groupId=creativeMap#87e2af7cf742#test] Node 6 was unable to process the fetch request with (sessionId=1346340004, epoch=56): FETCH_SESSION_ID_NOT_FOUND.

群集详细信息:
Broker: 13 (1 Broker : 14 cores & 36GB memory)
Kafka cluster version: 2.0.0
Kafka Java client version: 2.0.0
Number topics: ~15. 
Number of consumers: 7K (all independent and manually assigned all partitions of a topic to a consumers. One consumer is consuming all partitions from a topic only) 

最佳答案

增加max.incremental.fetch.session.cache.slots的值。默认值为1K,在我的情况下,我将其增加到10K并固定。

关于apache-kafka - Kafka : Continuously getting FETCH_SESSION_ID_NOT_FOUND,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/58484342/

相关文章:

java - 使用 Spring Boot 配置 Heroku Apache Kafka

java - 为组 xxx 提交偏移量时发生错误 UNKNOWN_MEMBER_ID

apache-kafka - Kafka集群需要多少内存?

java - 延迟kafka手动提交偏移有什么影响

apache-kafka - 如何使用 spring-kafka 为监听器传递多个引导服务器

docker - 无法从 logstash docker 容器连接到 kafka docker 容器

apache-kafka - 如何跨团队共享 avro 模式定义

apache-kafka - 如果 auto.offset.reset=earliest 但主题没有消息,将设置什么消费者偏移量

spring - 强制 Spring Boot 应用程序在无法连接到 Kafka 时失败

python - 基于时间戳值流式传输和处理数据(使用 Kafka 和 Spark Streaming)