Re: [EXTERNAL] [DISCUSS] KIP-308: Add a Kafka Source Connector to Kafka Connect

2018-05-28 Thread McCaig, Rhys
Sorry for the bad link to the KIP, here it is: https://cwiki.apache.org/confluence/display/KAFKA/KIP-308%3A+Add+a+Kafka+Source+Connector+to+Kafka+Connect > On May 28, 2018, at 10:19 PM, McCaig, Rhys wrote: > > Hi All, > > I added a KIP to include a Kafka Source Connector with Kafka Connect. >

[DISCUSS] KIP-308: Add a Kafka Source Connector to Kafka Connect

2018-05-28 Thread McCaig, Rhys
Hi All, I added a KIP to include a Kafka Source Connector with Kafka Connect. Here is the KIP:

[jira] [Created] (KAFKA-6963) KIP-308: Add a Kafka Source Connector to Kafka Connect

2018-05-28 Thread Rhys Anthony McCaig (JIRA)
Rhys Anthony McCaig created KAFKA-6963: -- Summary: KIP-308: Add a Kafka Source Connector to Kafka Connect Key: KAFKA-6963 URL: https://issues.apache.org/jira/browse/KAFKA-6963 Project: Kafka

Re: Avro to JSON

2018-05-28 Thread Gwen Shapira
Here's how you do it with KSQL: https://gist.github.com/miguno/40caf67d2f122d8da528d878c99a4e29 And then you can use Connect with JDBC connector to upload the result to SQL Server. On Mon, May 28, 2018 at 2:22 AM, wrote: > Hi Team, > > Looking for optimal solution to convert Avro format to

[jira] [Created] (KAFKA-6962) DescribeConfigsRequest Schema documentation is wrong/missing detail

2018-05-28 Thread Sean Policarpio (JIRA)
Sean Policarpio created KAFKA-6962: -- Summary: DescribeConfigsRequest Schema documentation is wrong/missing detail Key: KAFKA-6962 URL: https://issues.apache.org/jira/browse/KAFKA-6962 Project: Kafka

[jira] [Resolved] (KAFKA-6698) ConsumerBounceTest#testClose sometimes fails

2018-05-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-6698. --- Resolution: Cannot Reproduce > ConsumerBounceTest#testClose sometimes fails >

[DISCUSS] Why don't support web UI

2018-05-28 Thread ????????????
Hi team?? I'm curious that why we don't offer a web UI for administrators . The web UI is very useful to display cluster status and current topic status .

[jira] [Resolved] (KAFKA-6427) Inconsistent exception type from KafkaConsumer.position

2018-05-28 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-6427. -- Resolution: Fixed Fix Version/s: 2.0.0 Fixed in https://github.com/apache/kafka/pull/5005 >

Jenkins build is back to normal : kafka-trunk-jdk10 #144

2018-05-28 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-280: Enhanced log compaction

2018-05-28 Thread Matthias J. Sax
Luis, this week is feature freeze for the upcoming 2.0 release and most people focus on getting their PR merged. Thus, this and the next week (until code freeze) KIPs for 2.1 are not a high priority for most people. Please bear with us. Thanks for your understanding. -Matthias On 5/28/18 5:21

Build failed in Jenkins: kafka-trunk-jdk10 #143

2018-05-28 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Update consumer javadoc for invalid operations on unassigned -- [...truncated 1.53 MB...]

Permission to create KIP

2018-05-28 Thread Arseniy Tashoyan
Hi, Please give me permission to create KIP. id: tashoyan Arseniy Tashoyan

[jira] [Resolved] (KAFKA-4368) Unclean shutdown breaks Kafka cluster

2018-05-28 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-4368. -- Resolution: Auto Closed Closing inactive issue. > Unclean shutdown breaks Kafka cluster >

[jira] [Resolved] (KAFKA-6769) Upgrade jetty library version

2018-05-28 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-6769. -- Resolution: Fixed Fix Version/s: 2.0.0 Jetty version upgraded to 9.4.10.v20180503 in trunk. >

[jira] [Resolved] (KAFKA-5346) Kafka Producer Failure After Idle Time

2018-05-28 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5346. -- Resolution: Not A Problem Closing as per above comment. Please reopen if you think the issue still

Re: [DISCUSS] KIP-289: Improve the default group id behavior in KafkaConsumer

2018-05-28 Thread Vahid S Hashemian
Hi Viktor, Thanks for sharing your opinion. So you're in favor of disallowing the empty ("") group id altogether (even for fetching). Given that ideally no one should be using the empty group id (at least in a production setting) I think the impact would be minimal in either case. But as you

Re: [VOTE] KIP-264: Add a consumer metric to record raw fetch size

2018-05-28 Thread Viktor Somogyi
Hi Vahid, +1 (non-binding). The KIP looks good, will take a look at your PR tomorrow. Cheers, Viktor On Mon, May 28, 2018 at 6:03 AM, Ted Yu wrote: > lgtm > > On Fri, May 25, 2018 at 10:51 AM, Vahid S Hashemian < > vahidhashem...@us.ibm.com> wrote: > > > In the absence of

Re: [DISCUSS] KIP-280: Enhanced log compaction

2018-05-28 Thread Luís Cabral
Hi Guozhang, It doesn't look like there will be much feedback here. Is it alright if I just update the spec back to a standardized behaviour and move this along? Cheers,Luis On Thursday, May 24, 2018, 11:20:01 AM GMT+2, Luis Cabral wrote: Hi Jun / Ismael,

Re: [DISCUSS] KIP-289: Improve the default group id behavior in KafkaConsumer

2018-05-28 Thread Viktor Somogyi
Hi Vahid, (with the argument that using the default group id for offset commit should not be the user's intention in practice). Yea, so in my opinion too this use case doesn't seem too practical. Also I think breaking the offset commit is not smaller from this perspective than breaking fetch and

[jira] [Created] (KAFKA-6961) UnknownTopicOrPartitionException & NotLeaderForPartitionException upon replication of topics.

2018-05-28 Thread kaushik srinivas (JIRA)
kaushik srinivas created KAFKA-6961: --- Summary: UnknownTopicOrPartitionException & NotLeaderForPartitionException upon replication of topics. Key: KAFKA-6961 URL: https://issues.apache.org/jira/browse/KAFKA-6961

Avro to JSON

2018-05-28 Thread Madhu.Kartha
Hi Team, Looking for optimal solution to convert Avro format to JSON. The final objective is to save the JSON in Sql Server DB. If anyone of you have worked on this, please suggest the best option. Regards Madhu

[jira] [Created] (KAFKA-6960) Remove the methods from the internal Scala AdminClient that are provided by the new AdminClient

2018-05-28 Thread Attila Sasvari (JIRA)
Attila Sasvari created KAFKA-6960: - Summary: Remove the methods from the internal Scala AdminClient that are provided by the new AdminClient Key: KAFKA-6960 URL: https://issues.apache.org/jira/browse/KAFKA-6960

Re: TLS settings in librdkafka

2018-05-28 Thread Magnus Edenhill
Hi Valentin, after discussing this offline with Rajini we concluded that your solution for the JVM will work fine and there is no further correlation required between librdkafka and Java clients on this issue. Thanks, Magnus 2018-05-23 17:32 GMT+02:00 Valentín Gutierrez

[jira] [Created] (KAFKA-6959) Any impact we are foresee if we upgrade Linux version or move to VM

2018-05-28 Thread Gene Yi (JIRA)
Gene Yi created KAFKA-6959: -- Summary: Any impact we are foresee if we upgrade Linux version or move to VM Key: KAFKA-6959 URL: https://issues.apache.org/jira/browse/KAFKA-6959 Project: Kafka Issue