Posts

Showing posts from October, 2026

Kafka Batching

GitHub Copilot — Kafka Streams Rebalancing and Retry Issue: Root Cause Analysis Mode: ASK ONLY — STRICTLY NO CODE CHANGES I am working on Jira PRGCRM-5120, migrating the OneCRM DataService Kafka consumers from Spring @KafkaListener to native Kafka Streams ( KStream ), while preserving the existing batching and business-processing behavior. The implementation has been deployed in the CAE environment, and I have also performed local testing against the Confluent non-production cluster. I am experiencing prolonged consumer-group rebalancing in local testing, particularly for OCP CustExp, along with downstream processing failures and retry-related exceptions. I need a detailed, evidence-based root cause analysis of the actual current source code before making any modifications. 1. Inspect the complete implementation Read and trace these classes and relevant supporting code: ConfluentKafkaStreamsConfig.java KafkaStreamsBatchingProcessor.java ConfluentKafkaMessageConsumer.java ConfluentKaf...