[jira] [Created] (KAFKA-7900) JsonConverter - Floats should not be written in scientific notation.

2019-02-05 Thread Jeremy Custenborder (JIRA)
Jeremy Custenborder created KAFKA-7900: -- Summary: JsonConverter - Floats should not be written in scientific notation. Key: KAFKA-7900 URL: https://issues.apache.org/jira/browse/KAFKA-7900

[jira] [Resolved] (KAFKA-7899) Command line tool to invalidate group metadata for clean assignment

2019-02-05 Thread Boyang Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-7899. Resolution: Invalid It appears that the metadata should be generated by the client instead of

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2019-02-05 Thread Florian Hussonnois
Hi Matthias, Regaridng your feedback, I've updated the KIP and PR in a way that state store are only named regarding the provided Materialized. I have also overload the methods: join(GlobalKTable, KeyValueMapper, ValueJoiner)` and `leftJoin(GlobalKTable, KeyValueMapper, ValueJoiner)` (Sorry my

[jira] [Created] (KAFKA-7899) Command line tool to invalidate group metadata for clean assignment

2019-02-05 Thread Boyang Chen (JIRA)
Boyang Chen created KAFKA-7899: -- Summary: Command line tool to invalidate group metadata for clean assignment Key: KAFKA-7899 URL: https://issues.apache.org/jira/browse/KAFKA-7899 Project: Kafka

Re: [DISCUSS] KIP-426: Persist Broker Id to Zookeeper

2019-02-05 Thread Li Kan
My bad, forgot to put the link to the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-426%3A+Persist+Broker+Id+to+Zookeeper On Tue, Feb 5, 2019 at 2:38 PM Li Kan wrote: > Hi, I have KIP-426, which is a small change on automatically determining > broker id when starting up. I am new

[DISCUSS] KIP-426: Persist Broker Id to Zookeeper

2019-02-05 Thread Li Kan
Hi, I have KIP-426, which is a small change on automatically determining broker id when starting up. I am new to Kafka so there are a bunch of design trade-offs that I might be missing or hard to decide, so I'd like to get some suggestions on it. I'd expect (and open) to modify (or even totally

Jenkins build is back to normal : kafka-2.1-jdk8 #122

2019-02-05 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #3367

2019-02-05 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-7890: Invalidate ClusterConnectionState cache for a broker if the -- [...truncated 4.58 MB...]

Re: [VOTE] KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers

2019-02-05 Thread Bill Bejeck
Thanks for the KIP, Rohan. +1 (non-binding). -Bill On Tue, Feb 5, 2019 at 1:24 PM Manikumar wrote: > +1 (binding). Thanks for the KIP. > > On Tue, Feb 5, 2019 at 10:01 AM Gwen Shapira wrote: > > > Thanks for the KIP. > > +1 > > > > On Mon, Feb 4, 2019 at 1:56 PM Rohan Desai > > wrote: > > >

Re: [VOTE] KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers

2019-02-05 Thread Manikumar
+1 (binding). Thanks for the KIP. On Tue, Feb 5, 2019 at 10:01 AM Gwen Shapira wrote: > Thanks for the KIP. > +1 > > On Mon, Feb 4, 2019 at 1:56 PM Rohan Desai > wrote: > > > > Calling a vote for this since it's pretty trivial/non-controversial > > > > >

Build failed in Jenkins: kafka-2.2-jdk8 #4

2019-02-05 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-7890: Invalidate ClusterConnectionState cache for a broker if the -- [...truncated 2.60 MB...] kafka.controller.PartitionStateMachineTest

Re: [VOTE] KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers

2019-02-05 Thread Gwen Shapira
Thanks for the KIP. +1 On Mon, Feb 4, 2019 at 1:56 PM Rohan Desai wrote: > > Calling a vote for this since it's pretty trivial/non-controversial > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-425%3A+Add+some+Log4J+Kafka+Appender+Properties+for+Producing+to+Secured+Brokers -- Gwen

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2019-02-05 Thread Ryanne Dolan
Thanks Harsha, makes sense. Ryanne On Mon, Feb 4, 2019 at 5:53 PM Harsha Chintalapani wrote: > "I think you are saying that this enables additional (potentially cheaper) > storage options without *requiring* an existing ETL pipeline. “ > Yes. > > " But it's not really a replacement for the

[jira] [Created] (KAFKA-7898) ERROR Caught unexpected throwable (org.apache.zookeeper.ClientCnxn)

2019-02-05 Thread Gabriel Lukacs (JIRA)
Gabriel Lukacs created KAFKA-7898: - Summary: ERROR Caught unexpected throwable (org.apache.zookeeper.ClientCnxn) Key: KAFKA-7898 URL: https://issues.apache.org/jira/browse/KAFKA-7898 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk11 #265

2019-02-05 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-7890: Invalidate ClusterConnectionState cache for a broker if the -- [...truncated 2.29 MB...]

kafka core unit test failing

2019-02-05 Thread Rajkumar Natarajan
Hi, I've cloned the kafka project. Below is the latest commit I'm using. commit e942e294f0a700cdc2f94bb7f967c2e9bcb1a271 (HEAD -> trunk, origin/trunk, origin/HEAD) When I run the command `gradle core:test` one of the tests failed. kafka.api.ConsumerBounceTest >

Re: [DISCUSS] KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers

2019-02-05 Thread Dongjin Lee
@Rohan I reviewed both of the security feature and your KIP today, and now understanding what you are meaning! In short, you are trying to reach parity of the supported authentication mechanism[^1], configuration method[^2] between client and Log4J appender. Isn't it? Then, It would be much

Re: [VOTE] KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers

2019-02-05 Thread Dongjin Lee
Thanks for the KIP! +1 (non-binding). Thanks, Dongjin On Tue, Feb 5, 2019 at 6:56 AM Rohan Desai wrote: > Calling a vote for this since it's pretty trivial/non-controversial > > >

Build failed in Jenkins: kafka-2.1-jdk8 #121

2019-02-05 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-7890: Invalidate ClusterConnectionState cache for a broker if the -- [...truncated 1.11 MB...] kafka.common.InterBrokerSendThreadTest >

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2019-02-05 Thread Adam Bellemare
Hi Harsha Agreed with Eno: "However I'd argue that this KIP is about strengthening the role of Kafka as a long-term storage service" - Put the focus on the single source of truth being from Kafka, with clients not needing to source from multiple data sources. Also, clarify if the segment is

[jira] [Resolved] (KAFKA-7890) Invalidate ClusterConnectionState cache for a broker if the hostname of the broker changes.

2019-02-05 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7890. --- Resolution: Fixed Fix Version/s: 2.1.1 2.2.0 > Invalidate

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2019-02-05 Thread Eno Thereska
Thanks Harsha for the KIP. A couple of comments: - the motivation needs more work. I think some of the questions about ETL and other tools would benefit from a clearer motivation. In particular right now the motivation is mostly about reducing recovery time. However I'd argue that this KIP is

Build failed in Jenkins: kafka-2.2-jdk8 #3

2019-02-05 Thread Apache Jenkins Server
See Changes: [me] KAFKA-7834: Extend collected logs in system test services to include -- [...truncated 2.66 MB...] kafka.controller.PartitionLeaderElectionAlgorithmsTest >