KIP idea: Separate publish request from the subscribe request

Hi Kafka community, I like to surface a KIP idea, which is to separate publish request from the subscribe request using different ports. The context: We have some workload with over 5000 subscribers, the latency on publish latency can be as high as 3000 ms second. After investigation, we

Re: Requesting to add to contributor list and write access for wiki

What's your Jira and Wiki Ids? On 8/20/20 8:01 AM, Prithvi S wrote: > Hello Team, > > I am interested in contributing to Apache Kafka codebase. Kindly add me to > contributor list. It would help me in assigning myself to on Kafka Jiras. > Also, kindly grant me wiki write access to create KIP.

Re: virtual KIP meeting for KIP-405

Hello I am interested in attending, mostly just to listen and observe. Thanks ! > On Aug 20, 2020, at 6:20 PM, Jun Rao wrote: > > Hi, everyone, > > We plan to have weekly virtual meetings for KIP-405 to discuss progress and > outstanding issues, starting from this coming Tuesday at 9am PT.

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #24

See

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #25

See Changes: [github] KAFKA-10379: Implement the KIP-478 StreamBuilder#addGlobalStore() (#9148) -- [...truncated 3.22 MB...]

virtual KIP meeting for KIP-405

Hi, everyone, We plan to have weekly virtual meetings for KIP-405 to discuss progress and outstanding issues, starting from this coming Tuesday at 9am PT. If you are interested in attending, please let Harsha or me know. The recording of the meeting will be posted in

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

Hi Leah, Could you explain a bit more why we do not wish to let TimeWindowedDeserializer and WindowedSerdes be created without a specified time as a parameter? I understand the long.MAX_VALUE could cause problems but would it not be a good idea to have a usable default or fetch from the config

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #23

See Changes: [github] KAFKA-10379: Implement the KIP-478 StreamBuilder#addGlobalStore() (#9148) -- [...truncated 3.20 MB...]

[DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

Hi all, I'd like to start a discussion for KIP-659: https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size The goal of the KIP is to ensure that window size is passed to the consumer when needed, which will

Re: Requesting to add to contributor list and write access for wiki

Added both permissions, you are good to go. On Thu, Aug 20, 2020 at 8:05 AM sasilekha wrote: > Hello Team, > > I am interested in contributing to Apache Kafka codebase. Kindly add me to > contributor list. It would help me in assigning Jiras to myself on Kafka. > > Also, kindly grant me wiki

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #24

See

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #23

See Changes: [github] MINOR: Fix typo in LeaderEpochFileCacheTest (#9203) -- [...truncated 6.45 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Resolved] (KAFKA-9852) Lower block duration in BufferPoolTest to cut down on overall test runtime

[ https://issues.apache.org/jira/browse/KAFKA-9852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-9852. - Fix Version/s: 2.6.0 Resolution: Fixed > Lower block duration in BufferPoolTest to cut

[DISCUSS] KIP-661: Expose task configurations in Connect REST API

Hi, I've created KIP-661 expose the configuration of individual tasks in the Connect API https://cwiki.apache.org/confluence/display/KAFKA/KIP-661%3A+Expose+task+configurations+in+Connect+REST+API Please take a look and let me know if you have any feedback. Thanks

[DISCUSS] KIP-660: Pluggable ReplicaAssignor

Hi, I've created KIP-660 to make the replica assignment logic pluggable. https://cwiki.apache.org/confluence/display/KAFKA/KIP-660%3A+Pluggable+ReplicaAssignor Please take a look and let me know if you have any feedback. Thanks

Requesting to add to contributor list and write access for wiki

Hello Team, I am interested in contributing to Apache Kafka codebase. Kindly add me to contributor list. It would help me in assigning Jiras to myself on Kafka. Also, kindly grant me wiki write access to create KIP. Thanks in advance, Regards, Sasilekha

Requesting to add to contributor list and write access for wiki

Hello Team, I am interested in contributing to Apache Kafka codebase. Kindly add me to contributor list. It would help me in assigning myself to on Kafka Jiras. Also, kindly grant me wiki write access to create KIP. Thanks in advance, Regards, Prithvi

Re: [VOTE] KIP-657: Add Customized Kafka Streams Logo

Just adding my 2c. Whether "cute" is a good route to take for logos is pretty subjective, but I do think the approach can work. However, a logo being simple seems. This was echoed earlier in Robins 'can it be shrunk' comment. Visually there's a lot going on in both of those images. I think

Re: [DISCUSS] KIP-639 Move nodeLevelSensor and storeLevelSensor methods from StreamsMetricsImpl to StreamsMetrics

Thanks Mohamed for the updates! I really do not want to rain on your parade, but I am still not sure whether moving those methods from the StreamsMetricsImpl to the StreamsMetrics is the right approach to get rid of ProcessorContextUtils#getMetricsImpl(). I do also not agree about the

[jira] [Created] (KAFKA-10423) Logtash is restarting with invalid_fetch_session_epoch error

Akshay Sharma created KAFKA-10423: - Summary: Logtash is restarting with invalid_fetch_session_epoch error Key: KAFKA-10423 URL: https://issues.apache.org/jira/browse/KAFKA-10423 Project: Kafka

[jira] [Created] (KAFKA-10422) Provide a `timesForOffsets` operation in kafka consumer

Guillaume Bort created KAFKA-10422: -- Summary: Provide a `timesForOffsets` operation in kafka consumer Key: KAFKA-10422 URL: https://issues.apache.org/jira/browse/KAFKA-10422 Project: Kafka

Re: [VOTE] KIP-657: Add Customized Kafka Streams Logo

(just my honest opinion) I strongly oppose the suggested logos. I completely agree with Michael's analysis. The design appears to me to be quite random (regardless of the association of streams with otters) and clashes terribly with the embedded Kafka logo making it appear quite unprofessional.

Re: [VOTE] KIP-656: MirrorMaker2 Exactly-once Semantics

Thanks for looking into this, it would be a great feature Considering it's not a trivial feature, we should have a [DISCUSS] thread before starting a vote. On Mon, Aug 17, 2020 at 6:25 PM Ning Zhang wrote: > > Hello everyone, > > I'd like to start a vote on KIP-656. This KIP aims to make

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi Jun, Many thanks for your initiative. If you like, I am happy to attend at the time you suggested. Many thanks, Alexandre Le mer. 19 août 2020 à 22:00, Harsha Ch a écrit : > Hi Jun, > Thanks. This will help a lot. Tuesday will work for us. > -Harsha > > > On Wed, Aug 19, 2020 at

Re: [VOTE] KIP-657: Add Customized Kafka Streams Logo

For what it's worth, here is an example sketch that I came up with. Point is to show an alternative direction for the KStreams logo. https://ibb.co/bmZxDCg Thinking process: - It shows much more clearly (I hope) that KStreams is an official part of Kafka. - The Kafka logo is still