Re: Consumer Lag-Apache_kafka_JMX metrics

2022-08-16 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
As far as I know, such metric does not exist. Strictly speaking, consumer lag can be defined as the difference between the last produced offset (high watermark) and the last committed offset by the group, but such metric has very little value without considering the time dimension. It'd be

Re: Consumer Lag-Apache_kafka_JMX metrics

2022-08-16 Thread Kafka Life
Hello Experts, Any info or pointers on my query please. On Mon, Aug 15, 2022 at 11:36 PM Kafka Life wrote: > Dear Kafka Experts > we need to monitor the consumer lag in kafka clusters 2.5.1 and 2.8.0 > versions of kafka in Grafana. > > 1/ What is the correct path for JMX metrics to evaluate

[GitHub] [kafka-site] mimaison commented on pull request #435: MINOR:Clean up images

2022-08-16 Thread GitBox
mimaison commented on PR #435: URL: https://github.com/apache/kafka-site/pull/435#issuecomment-1216973319 @bbejeck I pushed new placeholders to your branch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1147

2022-08-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 421165 lines...] [2022-08-16T16:47:07.769Z] > Task :connect:api:javadoc [2022-08-16T16:47:09.037Z] > Task :connect:api:copyDependantLibs

Re: Last sprint to finish line: Replace EasyMock/Powermock with Mockito

2022-08-16 Thread Guozhang Wang
Thanks everyone for the great effort! Just one quick question regarding the Streams tests: I looked over https://github.com/apache/kafka/pull/12492/files, https://github.com/apache/kafka/pull/12505/files and https://github.com/apache/kafka/pull/12465/files, but I did not find the one covering

RE: [DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2022-08-16 Thread Yash Mayya
Apologies for the poor formatting on the quoted bits in the previous email. On 2021/11/03 22:17:06 Diego Erdody wrote: > Hello, > > I'd like to propose a small KIP to add a new field to SinkRecord in order > to add support for topic-mutating SMTs (e.g. RegexRouter) to asynchronous > Sink

[jira] [Created] (KAFKA-14169) Memory leak (?) with no activity

2022-08-16 Thread Ricardo Giacomin (Jira)
Ricardo Giacomin created KAFKA-14169: Summary: Memory leak (?) with no activity Key: KAFKA-14169 URL: https://issues.apache.org/jira/browse/KAFKA-14169 Project: Kafka Issue Type: Bug

RE: [DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2022-08-16 Thread Yash Mayya
Hi Diego, Thanks for writing this KIP. Are you still planning to work on this? If not, I'd be happy to try and take this to completion! Hi Chris, Thanks for your valuable inputs as always! > It looks like this KIP does not take the SinkTask::open and SinkTask::close methods into account > I

[jira] [Resolved] (KAFKA-14148) Outdated doc for reset-offsets option

2022-08-16 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14148. - Fix Version/s: 3.3.0 Resolution: Fixed > Outdated doc for reset-offsets option >

Re: [DISCISS] KIP-860: Add client-provided option to guard against unintentional replication factor change during partition reassignments

2022-08-16 Thread David Jacot
Thanks Stan. Overall, the KIP looks good to me. I have two minor comments: * Could we document the different versions in the AlterPartitionReassignmentsRequest/Request schema? You can look at other requests/responses to see how we have done this so far. * I wonder if

Re: Re: KIP 678: New Kafka Connect SMT for plainText => Struct(or Map) with Regex

2022-08-16 Thread gyejun choi
Hello Chris, Long time no feed back about this, do I have any work left to do to proceed with discuss and vote? I will waiting for your guide, thanks, always whsoul 2022년 6월 14일 (화) 오후 9:29, gyejun choi 님이 작성: > Hi Chris > > I updated KIP document > >

[jira] [Created] (KAFKA-14168) Constant memory usage increase

2022-08-16 Thread zhangdong7 (Jira)
zhangdong7 created KAFKA-14168: -- Summary: Constant memory usage increase Key: KAFKA-14168 URL: https://issues.apache.org/jira/browse/KAFKA-14168 Project: Kafka Issue Type: Bug