Build failed in Jenkins: kafka-2.4-jdk8 #148

2020-02-18 Thread Apache Jenkins Server
See Changes: [matthias] KAFKA-8025: Fix flaky RocksDB test (#8126) -- [...truncated 5.02 MB...] kafka.coordinator.group.GroupMetadataTest >

Build failed in Jenkins: kafka-2.5-jdk8 #31

2020-02-18 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Reduce log level to Trace for fetch offset downgrade (#8093) -- [...truncated 2.89 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Build failed in Jenkins: kafka-trunk-jdk11 #1171

2020-02-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6266: Repeated occurrence of WARN Resetting first dirty offset [github] MINOR: Reduce log level to Trace for fetch offset downgrade (#8093)

[jira] [Created] (KAFKA-9571) MirrorMaker task failing during pool

2020-02-18 Thread Nitish Goyal (Jira)
Nitish Goyal created KAFKA-9571: --- Summary: MirrorMaker task failing during pool Key: KAFKA-9571 URL: https://issues.apache.org/jira/browse/KAFKA-9571 Project: Kafka Issue Type: Bug

Re: [Discuss] KIP-571: Add option to force remove members in StreamsResetter

2020-02-18 Thread Boyang Chen
Also Feyman, there is one thing I forget which is that the leave group change was introduced in 2.4 broker instead of 2.3. Feel free to correct it on the KIP. On Tue, Feb 18, 2020 at 5:44 PM Sophie Blee-Goldman wrote: > Hey Feyman, > > Thanks for the KIP! I had two high-level questions: > > It

Build failed in Jenkins: kafka-trunk-jdk8 #4248

2020-02-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Reduce log level to Trace for fetch offset downgrade (#8093) -- [...truncated 2.88 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Build failed in Jenkins: kafka-2.5-jdk8 #30

2020-02-18 Thread Apache Jenkins Server
See Changes: [matthias] KAFKA-8025: Fix flaky RocksDB test (#8126) -- [...truncated 5.85 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [Discuss] KIP-571: Add option to force remove members in StreamsResetter

2020-02-18 Thread Sophie Blee-Goldman
Hey Feyman, Thanks for the KIP! I had two high-level questions: It seems like, in the specific case motivating this KIP, we would only ever want to remove *all* the members remaining in the group (and never just a single member at a time). As you mention there is already an admin API to remove

[jira] [Resolved] (KAFKA-9306) Kafka Consumer does not clean up all metrics after shutdown

2020-02-18 Thread Sanjana Kaundinya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjana Kaundinya resolved KAFKA-9306. -- Fix Version/s: 2.4.1 Resolution: Fixed > Kafka Consumer does not clean up all

Build failed in Jenkins: kafka-trunk-jdk8 #4247

2020-02-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6266: Repeated occurrence of WARN Resetting first dirty offset -- [...truncated 2.88 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Build failed in Jenkins: kafka-trunk-jdk11 #1170

2020-02-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-8025: Fix flaky RocksDB test (#8126) -- [...truncated 5.87 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest >

Re: [Discuss] KIP-571: Add option to force remove members in StreamsResetter

2020-02-18 Thread Boyang Chen
Thanks for the update Feyman. The updates look great, except one thing I would like to be more specific is error cases display. In the "*2)* Add cmdline option" you mention throwing exception when request failed, does that suggest partial failure or a full failure? How do we deal with different

Kafka Meetup hosted by Confluent at Mountain View, Thursday 5:30pm, Feb 20th, 2020

2020-02-18 Thread Guozhang Wang
Hello folks, This is a kind reminder of the Bay Area Kafka® meetup this Thursday (Feb. 20th) 5:30pm, at Confluent's Mountain View HQ office. *RSVP and Register* (if you intend to attend in person): https://www.meetup.com/KafkaBayArea/events/268427599/ *Date* 5:30pm, Thursday, February 20th,

Build failed in Jenkins: kafka-2.3-jdk8 #178

2020-02-18 Thread Apache Jenkins Server
See Changes: [matthias] KAFKA-8025: Fix flaky RocksDB test (#8126) -- [...truncated 2.55 MB...] kafka.log.LogCleanerTest > testSegmentWithOffsetOverflow PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #4246

2020-02-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-8025: Fix flaky RocksDB test (#8126) -- [...truncated 2.89 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

[jira] [Created] (KAFKA-9570) SSL cannot be configured for Connect in standalone mode

2020-02-18 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-9570: Summary: SSL cannot be configured for Connect in standalone mode Key: KAFKA-9570 URL: https://issues.apache.org/jira/browse/KAFKA-9570 Project: Kafka Issue

Build failed in Jenkins: kafka-2.2-jdk8-old #211

2020-02-18 Thread Apache Jenkins Server
See Changes: [matthias] KAFKA-8025: Fix flaky RocksDB test (#8126) -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables.

[jira] [Resolved] (KAFKA-8025) Flaky Test RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapterTest#shouldForwardAllDbOptionsCalls

2020-02-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8025. Resolution: Fixed > Flaky Test >

Re: Please give permission for KAFKA/KIP jiras

2020-02-18 Thread Guozhang Wang
I've added `galyo` to the list, and also I've just assigned you to the JIRA ticket. Guozhang On Tue, Feb 18, 2020 at 12:04 PM Guozhang Wang wrote: > Hello Csaba, > > I will add you to the contributor list so you can assign to yourself. > > > Guozhang > > On Tue, Feb 18, 2020 at 11:57 AM Galyó

Re: Please give permission for KAFKA/KIP jiras

2020-02-18 Thread Guozhang Wang
Hello Csaba, I will add you to the contributor list so you can assign to yourself. Guozhang On Tue, Feb 18, 2020 at 11:57 AM Galyó Csaba wrote: > Hello, > > > > My username is "galyo". I would like to contribute to the Kafka project and > for that I would like to open KIFs and assign KAFKA

Please give permission for KAFKA/KIP jiras

2020-02-18 Thread Galyó Csaba
Hello, My username is "galyo". I would like to contribute to the Kafka project and for that I would like to open KIFs and assign KAFKA jiras to myself. At the moment I was only able to report a new jira KAFKA-9546 but wasn't able to assign it to myself. Could you please add me as

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-18 Thread Richard Yu
Hi all, We are definitely making progress! @John should I emphasize in the proposed behavior changes that we are only doing binary equality checks for stateful operators? It looks like we have come close to finalizing this part of the KIP. (I will note in the KIP that this proposal is intended

[jira] [Resolved] (KAFKA-9540) Application getting "Could not find the standby task 0_4 while closing it" error

2020-02-18 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-9540. Fix Version/s: 2.6.0 Resolution: Fixed > Application getting "Could not

[jira] [Resolved] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved KAFKA-9512. --- Resolution: Fixed Closing since the PR is now landed > Flaky Test

[jira] [Created] (KAFKA-9569) RSM implementation for HDFS storage.

2020-02-18 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-9569: - Summary: RSM implementation for HDFS storage. Key: KAFKA-9569 URL: https://issues.apache.org/jira/browse/KAFKA-9569 Project: Kafka Issue Type: Sub-task

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-18 Thread John Roesler
Thanks, Matthias! Regarding numbers, it would be hard to know how many applications would benefit, since we don't know how many applications there are, or anything about their data sets or topologies. We could do a survey, but it seems overkill if we take the conservative approach. I have my own

[jira] [Created] (KAFKA-9568) Kstreams APPLICATION_SERVER_CONFIG is not updated with static membership

2020-02-18 Thread David J. Garcia (Jira)
David J. Garcia created KAFKA-9568: -- Summary: Kstreams APPLICATION_SERVER_CONFIG is not updated with static membership Key: KAFKA-9568 URL: https://issues.apache.org/jira/browse/KAFKA-9568 Project:

Regarding KAFKA logs

2020-02-18 Thread Dhruvil Doshi
Respected sir I am Dhruvil Doshi. Currently, I am trying to monitor kafka in kibana. Although I am not able to understand the logs in kafka i.e. server.log and controller.log . If you have any documentation based on logs can you please share with me. Thanks and Regards Dhruvil Doshi

[jira] [Created] (KAFKA-9567) Docs and system tests for ZooKeeper 3.5.7 and KIP-515

2020-02-18 Thread Ron Dagostino (Jira)
Ron Dagostino created KAFKA-9567: Summary: Docs and system tests for ZooKeeper 3.5.7 and KIP-515 Key: KAFKA-9567 URL: https://issues.apache.org/jira/browse/KAFKA-9567 Project: Kafka Issue

[jira] [Created] (KAFKA-9566) ProcessorContextImpl#forward throws NullPointerException if invoked from DeserializationExceptionHandler

2020-02-18 Thread Tomas Mi (Jira)
Tomas Mi created KAFKA-9566: --- Summary: ProcessorContextImpl#forward throws NullPointerException if invoked from DeserializationExceptionHandler Key: KAFKA-9566 URL: https://issues.apache.org/jira/browse/KAFKA-9566

Kafka latency spikes analysis

2020-02-18 Thread Paolo Moriello
Hello, I'm performing an investigation on Kafka latency. During my analysis I was able to reproduce a scenario in which Kafka latency repeatedly spikes at constant frequency, for small amounts of time. In my tests, in particular, latency could spike every ~2 minutes (dependently on the

Re: [DISCUSS] KIP-498: Add client-side configuration for maximum response size to protect against OOM

2020-02-18 Thread Alexandre Dupriez
Hello, Thanks David to propose a new PR [1] for KIP-498 [2] to address KAFKA-4090 [3]. I find it interesting, I wonder how it stands w.r.t. avoiding inter-layer violation. [1] https://github.com/apache/kafka/pull/8066 [2] https://issues.apache.org/jira/browse/KAFKA-4090 [3]

[jira] [Created] (KAFKA-9565) Implementation of Tiered Storage SPI to integrate with S3

2020-02-18 Thread Alexandre Dupriez (Jira)
Alexandre Dupriez created KAFKA-9565: Summary: Implementation of Tiered Storage SPI to integrate with S3 Key: KAFKA-9565 URL: https://issues.apache.org/jira/browse/KAFKA-9565 Project: Kafka