[jira] [Created] (KAFKA-15309) Add custom error handler to Producer

2023-08-04 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-15309: --- Summary: Add custom error handler to Producer Key: KAFKA-15309 URL: https://issues.apache.org/jira/browse/KAFKA-15309 Project: Kafka Issue Type: New

Re: Testing FixedKeyProcessor implementation using unit tests

2023-08-04 Thread Matthias J. Sax
Thanks for filing a ticket for it: https://issues.apache.org/jira/browse/KAFKA-15242 On 7/14/23 1:06 AM, EXT.Zlatibor.Veljkovic wrote: Hi Matthias, Here's the repro of the project that has these issues https://github.com/zveljkovic/kafka-repro. Please look at the: Topology definition:

[jira] [Created] (KAFKA-15308) Wipe Stores upon OffsetOutOfRangeException in ALOS

2023-08-04 Thread Colt McNealy (Jira)
Colt McNealy created KAFKA-15308: Summary: Wipe Stores upon OffsetOutOfRangeException in ALOS Key: KAFKA-15308 URL: https://issues.apache.org/jira/browse/KAFKA-15308 Project: Kafka Issue

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-08-04 Thread Matthias J. Sax
Thanks a lot for providing more background. It's getting much clear to me now. Couple of follow up questions: It is not possible to use table-table join in this case because triggering events are supplied separately from the actual data entity that needs to be "assembled" and these events

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-04 Thread Matthias J. Sax
Guozhang, thanks for pointing out ValueJoinerWithKey. In the end, it's just a documentation change, ie, point out that the passed in key could be `null` and similar? -Matthias On 8/2/23 3:20 PM, Guozhang Wang wrote: Thanks Florin for the writeup, One quick thing I'd like to bring up is

[jira] [Created] (KAFKA-15307) Kafka Streams configuration docs outdate

2023-08-04 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-15307: --- Summary: Kafka Streams configuration docs outdate Key: KAFKA-15307 URL: https://issues.apache.org/jira/browse/KAFKA-15307 Project: Kafka Issue Type:

[GitHub] [kafka-site] mjsax opened a new pull request, #536: MINOR: update Kafka Streams state.dir doc

2023-08-04 Thread via GitHub
mjsax opened a new pull request, #536: URL: https://github.com/apache/kafka-site/pull/536 Default state directory was changes in 2.8.0 release (cf KAFKA-10604) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Created] (KAFKA-15306) Integrate committed offsets logic when updating fetching positions

2023-08-04 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15306: -- Summary: Integrate committed offsets logic when updating fetching positions Key: KAFKA-15306 URL: https://issues.apache.org/jira/browse/KAFKA-15306 Project:

RE: [DISCUSS] KIP-714: Client metrics and observability

2023-08-04 Thread Doğuşcan Namal
Hi Andrew, thanks a lot for this KIP. I was thinking of something similar so thanks for writing this down  Couple of questions related to the design: 1. Can we investigate the option for using the Kraft controllers instead of the brokers for sending metrics? The disadvantage of sending

[jira] [Created] (KAFKA-15305) The background thread should try to process the remaining task until the shutdown timer is expired

2023-08-04 Thread Philip Nee (Jira)
Philip Nee created KAFKA-15305: -- Summary: The background thread should try to process the remaining task until the shutdown timer is expired Key: KAFKA-15305 URL: https://issues.apache.org/jira/browse/KAFKA-15305

[jira] [Created] (KAFKA-15304) CompletableApplicationEvents aren't being completed when the consumer is closing

2023-08-04 Thread Philip Nee (Jira)
Philip Nee created KAFKA-15304: -- Summary: CompletableApplicationEvents aren't being completed when the consumer is closing Key: KAFKA-15304 URL: https://issues.apache.org/jira/browse/KAFKA-15304

Re: [DISCUSS] Cluster-wide disablement of Tiered Storage

2023-08-04 Thread Divij Vaidya
Hey folks Option 4.1 is what was posted as the proposed solution for "early access" in the 3.6 release email thread earlier in the day today. Please refer to the document attached to that email thread: https://lists.apache.org/thread/9chh6h52xf2p6fdsqojy25w7k6jqlrkj and leave your thoughts on

Re: [DISCUSS] Cluster-wide disablement of Tiered Storage

2023-08-04 Thread Andrew Schofield
Hi Christo, I agree with you. Option 4.1 without a KIP seems like an acceptable starting point for something which will be relatively rare, provided that it’s easy for the user to get a list of the topics that have to be deleted before they can successfully start the broker with TS turned off.

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2069

2023-08-04 Thread Apache Jenkins Server
See

[DISCUSS] Cluster-wide disablement of Tiered Storage

2023-08-04 Thread Christo Lolov
Hello all! I wanted to gather more opinions for https://issues.apache.org/jira/browse/KAFKA-15267 In summary, the problem which I would like to solve is disabling TS (and freeing the resources used by RemoteLog*Manager) because I have decided I no longer want to use it without having to

Re: [DISCUSS] KIP-714: Client metrics and observability

2023-08-04 Thread Andrew Schofield
Hi Doguscan, Thanks for your comments. I’m glad to hear you’re interested in this KIP. 1) It is preferred that a client sends its metrics to the same broker connection but actually it is able to send them to any broker. As a result, if a broker becomes unhealthy, the client can push its metrics

Re: Apache Kafka 3.6.0 release

2023-08-04 Thread Chris Egerton
Thanks for adding KIP-949, Satish! On Fri, Aug 4, 2023 at 7:06 AM Satish Duggana wrote: > Hi, > Myself and Divij discussed and added the wiki for Kafka TieredStorage > Early Access Release[1]. If you have any comments or feedback, please > feel free to share them. > > 1. >

Fwd: [DISCUSS] KIP-714: Client metrics and observability

2023-08-04 Thread Doğuşcan Namal
Hi Andrew, thanks a lot for this KIP. I was thinking of something similar so thanks for writing this down  Couple of questions related to the design: 1. Can we investigate the option for using the Kraft controllers instead of the brokers for sending metrics? The disadvantage of sending

Re: Apache Kafka 3.6.0 release

2023-08-04 Thread Satish Duggana
Hi, Myself and Divij discussed and added the wiki for Kafka TieredStorage Early Access Release[1]. If you have any comments or feedback, please feel free to share them. 1. https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Tiered+Storage+Early+Access+Release+Notes Thanks, Satish. On Fri,

[jira] [Created] (KAFKA-15303) Foreign key joins no longer triggered by events on the right side of the join after deployment with a new compatible Avro schema

2023-08-04 Thread Charles-Eddy (Jira)
Charles-Eddy created KAFKA-15303: Summary: Foreign key joins no longer triggered by events on the right side of the join after deployment with a new compatible Avro schema Key: KAFKA-15303 URL:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2068

2023-08-04 Thread Apache Jenkins Server
See Changes: -- [...truncated 399101 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 183 > TableTableJoinIntegrationTest > [caching enabled =

[jira] [Resolved] (KAFKA-14598) Fix flaky ConnectRestApiTest

2023-08-04 Thread Ashwin Pankaj (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Pankaj resolved KAFKA-14598. --- Resolution: Fixed Did not observe this recently > Fix flaky ConnectRestApiTest >

[VOTE] KIP-714: Client metrics and observability

2023-08-04 Thread Andrew Schofield
Hi, After almost 2 1/2 years in the making, I would like to call a vote for KIP-714 (https://cwiki.apache.org/confluence/display/KAFKA/KIP-714%3A+Client+metrics+and+observability). This KIP aims to improve monitoring and troubleshooting of client performance by enabling clients to push metrics