[jira] [Created] (KAFKA-8712) Build Kafka Streams against Scala 2.13

Loic DIVAD created KAFKA-8712: - Summary: Build Kafka Streams against Scala 2.13 Key: KAFKA-8712 URL: https://issues.apache.org/jira/browse/KAFKA-8712 Project: Kafka Issue Type: New Feature

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

Hey again Matthias, I think it might help to frame the evaluation of the Context question if we have a "spitball" proposal for what change we might want to make to the context. Currently, the ProcessorContext is referenced in the following public interfaces:

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

Hey Matthias, I agree, it's worth double-checking to make sure that the upgrade path would be smooth. There's no point in putting ourselves in an awkward jam. I'll look into it and report back. Regarding the global store logic, I confirmed that the "state update processor" shouldn't be

Re: [VOTE] KIP-466: Add support for List serialization and deserialization

Hi, Thank you everyone! KIP-466 Add support for List serialization and deserialization will be marked as accepted with 3 binding votes: Bill Bejeck, Guozhang Wang, and Matthias J. Sax. Best, Daniyar Yeralin > On Jul 24, 2019, at 5:12 PM, Bill Bejeck wrote: > > Thanks for the KIP looks to

Re: [VOTE] KIP-466: Add support for List serialization and deserialization

Thanks for the KIP looks to be very helpful. +1(binding) -Bill On Wed, Jul 24, 2019 at 5:01 PM Guozhang Wang wrote: > +1 (binding). > > Thanks Daniyar! > > On Wed, Jul 24, 2019 at 12:04 PM John Roesler wrote: > > > Thanks, Daniyar, > > > > I'm +1 (nonbinding) > > > > -John > > > > On Tue,

Re: [VOTE] KIP-466: Add support for List serialization and deserialization

+1 (binding). Thanks Daniyar! On Wed, Jul 24, 2019 at 12:04 PM John Roesler wrote: > Thanks, Daniyar, > > I'm +1 (nonbinding) > > -John > > On Tue, Jun 11, 2019 at 1:45 PM Development wrote: > > > Hello, > > > > I want to start a vote for KIP-466 < > > >

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

Hi Matthias, Thanks for the suggestion. I Don’t have strong opinion on that one. Agree that avoiding unnecessary method overloads is a good idea. Updated KIP Regards, Levani > On Jul 24, 2019, at 8:50 PM, Matthias J. Sax wrote: > > One question: > > Why do we add > >>

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

If we don't fix the `ProcessorContext` now, how would an upgrade path look like? We woudl deprecate existing `init()` and add a new `init()`, and during runtime need to call both? This sound rather error prone to me and might be confusing to users? Hence, it might be beneficial to fix it right

[jira] [Created] (KAFKA-8711) Kafka 2.3.0 Transient Unit Test Failures SocketServerTest. testControlPlaneRequest

Chandrasekhar created KAFKA-8711: Summary: Kafka 2.3.0 Transient Unit Test Failures SocketServerTest. testControlPlaneRequest Key: KAFKA-8711 URL: https://issues.apache.org/jira/browse/KAFKA-8711

Re: [VOTE] KIP-466: Add support for List serialization and deserialization

Thanks, Daniyar, I'm +1 (nonbinding) -John On Tue, Jun 11, 2019 at 1:45 PM Development wrote: > Hello, > > I want to start a vote for KIP-466 < > https://cwiki.apache.org/confluence/display/KAFKA/KIP-466:+Add+support+for+List%3CT%3E+serialization+and+deserialization > < >

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

Hey Matthias, Thanks for the review! I agree about ProcessorContext, it could certainly be split up to improve compile-time clues about what is or is not permitted (like, do you just want to be able to see the extra record context vs. forawrding vs. registering state stores, as you said). But,

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

Thanks! Glad we are on the same page on how to address the cyclic dependency issue. -Matthias On 7/24/19 8:09 AM, Development wrote: > KIP-466 is updated and new commit is pushed. > > Thank you guys! > >> On Jul 24, 2019, at 10:53 AM, John Roesler wrote: >> >> Ah, thanks for setting me

Re: [VOTE] KIP-466: Add support for List serialization and deserialization

+1 (binding) On 7/18/19 11:37 AM, Guozhang Wang wrote: > +1 (binding). Thanks Daniyar! > > > Guozhang > > On Tue, Jul 16, 2019 at 2:13 PM John Roesler wrote: > >> Thanks, Daniyar! >> >> I'm +1 (nonbinding) >> >> -John >> >> On Tue, Jul 16, 2019 at 3:14 PM Development wrote: >>> >>> Hi, >>>

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

One question: Why do we add > Repartitioned#with(final String name, final int numberOfPartitions) It seems that `#with(String name)`, `#numberOfPartitions(int)` in combination with `withName()` and `withNumberOfPartitions()` should be sufficient. Users can chain the method calls. (I think it's

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

I have concerns about the latest proposal from Guozhang. However, as John said it's beyond the scope of this KIP and thus, I don't go into details. I agree thought, that the current "transformer APIs" are not ideal and could be improved. An orthogonal though is that we should split the current

Re: [DISCUSS] KIP-487: Automatic Topic Creation on Producer

Hi, Just a friendly reminder to take a look at this KIP if you have the time. I was thinking about broker vs. client default precedence, and I think it makes sense to keep the broker as the default used when both client-side and broker-side defaults are configured. The idea is that there would be

Re: [VOTE] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

Looks good! Thanks Levani, +1 (non-binding) Sophie On Tue, Jul 23, 2019 at 2:16 PM Levani Kokhreidze wrote: > Hello, > > I’d like to initialize voting on KIP-221: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-221%3A+Enhance+KStream+with+Connecting+Topic+Creation+and+Repartition+Hint

Re: [DISCUSS] KIP-490: log when consumer groups lose a message because offset has been deleted

Hello Kamal, The compacted topics are excluded from the KIP, because users of compacted topics are mainly interested on the last state for a certain key, and can afford to miss intermediary states. Technically is possible to know if the topic is compacted through "log.config.compact" attribute.

Re: Fwd: [DISCUSS] KIP-492 Add java security providers in Kafka Security config

Thanks for the details. Rajini, Can you please take a look and let us know if these addresses your concerns. Thanks, Harsha On Mon, Jul 22, 2019, at 9:36 AM, Sandeep Mopuri wrote: > Hi Rajini, > Thanks for raising the above questions. Please find the > replies below > > On Wed,

[jira] [Created] (KAFKA-8710) InitProducerId changes for KIP-360

Bob Barrett created KAFKA-8710: -- Summary: InitProducerId changes for KIP-360 Key: KAFKA-8710 URL: https://issues.apache.org/jira/browse/KAFKA-8710 Project: Kafka Issue Type: Improvement

Re: [VOTE] KIP-478 Strongly Typed Streams Processor API

Yeah I think I agree with you. +1 (binding) from me. Guozhang On Wed, Jul 24, 2019 at 7:43 AM John Roesler wrote: > Hi Guozhang, > > Thanks! I just replied in the discuss thread. I agree with what you're > proposing, but would like to consider it outside the scope of this KIP, if > that's

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

Sounds good to me, thanks John! Guozhang On Wed, Jul 24, 2019 at 7:40 AM John Roesler wrote: > Hey Guozhang, > > Thanks for the thought! It sounds related to what I was thinking in > https://issues.apache.org/jira/browse/KAFKA-8396 , but a little "extra"... > > I proposed to eliminate

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

KIP-466 is updated and new commit is pushed. Thank you guys! > On Jul 24, 2019, at 10:53 AM, John Roesler wrote: > > Ah, thanks for setting me straight, Matthias. > > Given the choice between defining the Serde in the streams module (hence it > would not be in the Serdes "menu" class) or

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

Ah, thanks for setting me straight, Matthias. Given the choice between defining the Serde in the streams module (hence it would not be in the Serdes "menu" class) or defining the configuration property in CommonClientConfig, I think I'm leaning toward the latter. Really good catch on the

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

Hey Matthias, Yes, you are totally right, “list.key/value.serializer.type" in ProducerConfigs. Removed! And yes, now StreamsConfig just points to configs stored in CommonClientsConfig. I’ll update the KIP. I think we can continue with voting now. Best, Daniyar Yeralin > On Jul 23, 2019, at

Re: [VOTE] KIP-478 Strongly Typed Streams Processor API

Hi Guozhang, Thanks! I just replied in the discuss thread. I agree with what you're proposing, but would like to consider it outside the scope of this KIP, if that's ok with you. -John On Tue, Jul 23, 2019 at 5:38 PM Guozhang Wang wrote: > Hi John, > > I left another question regarding

Re: [DISCUSS] KIP-478 Strongly Typed Processor API

Hey Guozhang, Thanks for the thought! It sounds related to what I was thinking in https://issues.apache.org/jira/browse/KAFKA-8396 , but a little "extra"... I proposed to eliminate ValueTransformer, but I believe you're right; we could eliminate Transformer also and just use Processor in the

[jira] [Created] (KAFKA-8709) hard fail on "Unknown group metadata version"

Christian Becker created KAFKA-8709: --- Summary: hard fail on "Unknown group metadata version" Key: KAFKA-8709 URL: https://issues.apache.org/jira/browse/KAFKA-8709 Project: Kafka Issue

Re: KIP-382 + Kafka Streams Question

Hi Ryanne > Lemme know if I haven't answered this clearly. Nope, this was very helpful. Thank you! > A single "stream" can come from multiple input topics I overlooked that - I was thinking of simply using the StreamBuilder.table() functionality instead, but that function doesn't support a

Re: Kafka consumer is not reading some partition

Hi, Maybe it would be helpful if you can attach the logs for your consumers when you notice they stopped consuming from some of your partitions On Tue, 23 Jul 2019 at 16:56, Sergey Fedorov wrote: > Hello. I was using Kafka 2.1.1 and facing a problem where our consumers > sometimes

Build failed in Jenkins: kafka-trunk-jdk8 #3809

See Changes: [wangguoz] KAFKA-8696: clean up Sum/Count/Total metrics (#7057) -- [...truncated 6.45 MB...] org.apache.kafka.connect.transforms.TimestampConverterTest >

[jira] [Created] (KAFKA-8708) Zookeeper Session expired either before or while waiting for connection

Chethan Bheemaiah created KAFKA-8708: Summary: Zookeeper Session expired either before or while waiting for connection Key: KAFKA-8708 URL: https://issues.apache.org/jira/browse/KAFKA-8708

[jira] [Created] (KAFKA-8707) Zookeeper Session expired either before or while waiting for connection

Chethan Bheemaiah created KAFKA-8707: Summary: Zookeeper Session expired either before or while waiting for connection Key: KAFKA-8707 URL: https://issues.apache.org/jira/browse/KAFKA-8707