Re: [DISCUSS] KIP-4 Create Topic Schema

Why disconnect the client on a InvalidRequestException? The 2 errors you are catching are both topic-level: (1) multiple requests for the same topic, and (2) ReplicaAssignment and num_partitions / replication_factor both set. Wouldn't it be better to just error the offending create_topic_request,

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

+1 On Thu, Jun 16, 2016 at 8:50 PM, tao xiao wrote: > +1 > > On Fri, 17 Jun 2016 at 09:03 Harsha wrote: > > > +1 (binding) > > Thanks, > > Harsha > > > > On Thu, Jun 16, 2016, at 05:46 PM, Henry Cai wrote: > > > +1 > > > > > > On Thu, Jun 16, 2016 at 3:46

[jira] [Work started] (KAFKA-3842) Add Helper Functions Into TestUtils

[ https://issues.apache.org/jira/browse/KAFKA-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3842 started by Bill Bejeck. -- > Add Helper Functions Into TestUtils > --- > >

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

+1 On Fri, 17 Jun 2016 at 09:03 Harsha wrote: > +1 (binding) > Thanks, > Harsha > > On Thu, Jun 16, 2016, at 05:46 PM, Henry Cai wrote: > > +1 > > > > On Thu, Jun 16, 2016 at 3:46 PM, Ismael Juma wrote: > > > > > +1 (binding) > > > > > > On Fri, Jun 17, 2016

Build failed in Jenkins: kafka-trunk-jdk8 #704

See Changes: [ismael] KAFKA-3691; Confusing logging during metadata update timeout [wangguoz] KAFKA-3805: Check if DB is null. -- [...truncated 13314 lines...]

Re: [VOTE] KIP-4 Create Topics Schema

+1 (binding) Thanks, Harsha On Thu, Jun 16, 2016, at 04:15 PM, Guozhang Wang wrote: > +1. > > On Thu, Jun 16, 2016 at 3:47 PM, Ismael Juma wrote: > > > +1 (binding) > > > > On Thu, Jun 16, 2016 at 11:50 PM, Grant Henke wrote: > > > > > I would like to

Jenkins build is back to normal : kafka-0.10.0-jdk7 #127

See

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

+1 (binding) Thanks, Harsha On Thu, Jun 16, 2016, at 05:46 PM, Henry Cai wrote: > +1 > > On Thu, Jun 16, 2016 at 3:46 PM, Ismael Juma wrote: > > > +1 (binding) > > > > On Fri, Jun 17, 2016 at 12:44 AM, Guozhang Wang > > wrote: > > > > > ＋1. > > > > > >

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

+1 On Thu, Jun 16, 2016 at 3:46 PM, Ismael Juma wrote: > +1 (binding) > > On Fri, Jun 17, 2016 at 12:44 AM, Guozhang Wang > wrote: > > > ＋1. > > > > On Thu, Jun 16, 2016 at 11:44 AM, Jason Gustafson > > wrote: > > > > > Hi All, > > >

Build failed in Jenkins: kafka-trunk-jdk7 #1371

See Changes: [wangguoz] KAFKA-3805: Check if DB is null. -- [...truncated 3298 lines...] kafka.coordinator.GroupMetadataManagerTest > testStoreNonEmptyGroup PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #703

See Changes: [ismael] MINOR: Follow-up from KAFKA-2720 with comment/style fixes -- [...truncated 8122 lines...] org.apache.kafka.common.metrics.JmxReporterTest > testJmxRegistration PASSED

[jira] [Commented] (KAFKA-3854) Consecutive regex subscription calls fail

[ https://issues.apache.org/jira/browse/KAFKA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335008#comment-15335008 ] Bharat Viswanadham commented on KAFKA-3854: --- Hi vahid, Thats fine. I will have a look in to

[jira] [Work started] (KAFKA-3853) Report offsets for empty groups in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3853 started by Vahid Hashemian. -- > Report offsets for empty groups in ConsumerGroupCommand >

[jira] [Work started] (KAFKA-3854) Consecutive regex subscription calls fail

[ https://issues.apache.org/jira/browse/KAFKA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3854 started by Vahid Hashemian. -- > Consecutive regex subscription calls fail >

[jira] [Commented] (KAFKA-3854) Consecutive regex subscription calls fail

[ https://issues.apache.org/jira/browse/KAFKA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335004#comment-15335004 ] Vahid Hashemian commented on KAFKA-3854: Hi [~bharatviswa]. I have already started working on it.

[jira] [Assigned] (KAFKA-3729) Auto-configure non-default SerDes passed alongside the topology builder

[ https://issues.apache.org/jira/browse/KAFKA-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned KAFKA-3729: - Assignee: Bharat Viswanadham > Auto-configure non-default SerDes passed

[jira] [Commented] (KAFKA-3854) Consecutive regex subscription calls fail

[ https://issues.apache.org/jira/browse/KAFKA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334973#comment-15334973 ] Bharat Viswanadham commented on KAFKA-3854: --- Hi Vahid, Can I take this PR, if you have not

[jira] [Commented] (KAFKA-3859) Consumer group is stuck in rebalancing status

[ https://issues.apache.org/jira/browse/KAFKA-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334962#comment-15334962 ] Vahid Hashemian commented on KAFKA-3859: cc [~hachikuji]. Not sure whether this is the expected

Build failed in Jenkins: kafka-trunk-jdk7 #1370

See Changes: [ismael] MINOR: Follow-up from KAFKA-2720 with comment/style fixes [ismael] KAFKA-3691; Confusing logging during metadata update timeout -- [...truncated 8598 lines...]

[jira] [Updated] (KAFKA-3859) Consumer group is stuck in rebalancing status

[ https://issues.apache.org/jira/browse/KAFKA-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-3859: --- Description: * I have a topic (1 partition) and a producer and new consumer that produce to

[jira] [Created] (KAFKA-3859) Consumer group is stuck in rebalancing status

Vahid Hashemian created KAFKA-3859: -- Summary: Consumer group is stuck in rebalancing status Key: KAFKA-3859 URL: https://issues.apache.org/jira/browse/KAFKA-3859 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-3185) Allow users to cleanup internal data

[ https://issues.apache.org/jira/browse/KAFKA-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334945#comment-15334945 ] Ishita Mandhan commented on KAFKA-3185: --- Ah okay, sounds good- I'll look for something else. thank

[jira] [Resolved] (KAFKA-3805) Running multiple instances of a Streams app on the same machine results in Java_org_rocksdb_RocksDB_write error

[ https://issues.apache.org/jira/browse/KAFKA-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3805. -- Resolution: Fixed Fix Version/s: 0.10.0.1 Issue resolved by pull request 1485

[jira] [Commented] (KAFKA-3805) Running multiple instances of a Streams app on the same machine results in Java_org_rocksdb_RocksDB_write error

[ https://issues.apache.org/jira/browse/KAFKA-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334935#comment-15334935 ] ASF GitHub Bot commented on KAFKA-3805: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1485: KAFKA-3805: Check if DB is null.

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1485 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3185) Allow users to cleanup internal data

[ https://issues.apache.org/jira/browse/KAFKA-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334926#comment-15334926 ] Guozhang Wang commented on KAFKA-3185: -- I think [~mjsax] has already started working on this, but did

Re: [VOTE] KIP-4 Create Topics Schema

+1. On Thu, Jun 16, 2016 at 3:47 PM, Ismael Juma wrote: > +1 (binding) > > On Thu, Jun 16, 2016 at 11:50 PM, Grant Henke wrote: > > > I would like to initiate the voting process for the "KIP-4 Create Topics > > Schema changes". This is not a vote for all

Re: [DISCUSS] Java 8 as a minimum requirement

I think moving from Java 7 to 8 for Kafka Streams won't be of a big issue. What specific concerns do you have Jeff? On Thu, Jun 16, 2016 at 2:12 PM, Jeff Klukas wrote: > Would the move to Java 8 be for all modules? I'd have some concern about > removing Java 7 compatibility

Re: avro-console-producer issue for Kafka Stream example PageViewRegionLambdaExample

Here is my understanding about Avro "union type (or optional field if one of its union value is null)": 1. Even for such fields, you need to specify them as "null" in your data, such as {"region" : "US", "experience" : null}. 2. And if you do have a value for these union fields, you need to

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

Harsha, Another question. 9. How would the delegation token be configured in the client? The standard way is to do this through JAAS. However, we will need to think through if this is convenient in a shared environment. For example, when a new task is added to a Storm worker node, do we need to

[jira] [Commented] (KAFKA-3755) tightening the offset check in ReplicaFetcherThread

[ https://issues.apache.org/jira/browse/KAFKA-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334892#comment-15334892 ] ASF GitHub Bot commented on KAFKA-3755: --- Github user imandhan closed the pull request at:

[GitHub] kafka pull request #1506: KAFKA-3755 Tightening the offset check in ReplicaF...

Github user imandhan closed the pull request at: https://github.com/apache/kafka/pull/1506 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-3755) tightening the offset check in ReplicaFetcherThread

[ https://issues.apache.org/jira/browse/KAFKA-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-3755. Resolution: Not A Problem As notes in the PR, looks like Log.append() already has that check. See

Re: [VOTE] KIP-4 Create Topics Schema

+1 (binding) On Thu, Jun 16, 2016 at 11:50 PM, Grant Henke wrote: > I would like to initiate the voting process for the "KIP-4 Create Topics > Schema changes". This is not a vote for all of KIP-4, but specifically for > the create topics changes. I have included the exact

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

+1 (binding) On Fri, Jun 17, 2016 at 12:44 AM, Guozhang Wang wrote: > ＋1. > > On Thu, Jun 16, 2016 at 11:44 AM, Jason Gustafson > wrote: > > > Hi All, > > > > I'd like to open the vote for KIP-62. This proposal attempts to address > one > > of the

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

＋1. On Thu, Jun 16, 2016 at 11:44 AM, Jason Gustafson wrote: > Hi All, > > I'd like to open the vote for KIP-62. This proposal attempts to address one > of the recurring usability problems that users of the new consumer have > faced with as little impact as possible. You can

[jira] [Commented] (KAFKA-3185) Allow users to cleanup internal data

[ https://issues.apache.org/jira/browse/KAFKA-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334860#comment-15334860 ] Ishita Mandhan commented on KAFKA-3185: --- [~guozhang] Do you think this is a bug a newbie(aka me)

Re: [VOTE] KIP-55: Secure quotas for authenticated users

Rajini, Thanks for the update. A few more questions/comments. 10. For the quota value stored in ZK, since we are adding an optional user_principal field in the json, we should bump the version from 1 to 2. Also, user_principal is not really part of the config values. So, perhaps we should

[jira] [Updated] (KAFKA-3691) Confusing logging during metadata update timeout

[ https://issues.apache.org/jira/browse/KAFKA-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3691: --- Resolution: Fixed Fix Version/s: (was: 0.10.0.1) Status: Resolved (was: Patch

[jira] [Commented] (KAFKA-3691) Confusing logging during metadata update timeout

[ https://issues.apache.org/jira/browse/KAFKA-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334834#comment-15334834 ] ASF GitHub Bot commented on KAFKA-3691: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1509: KAFKA-3691: Confusing logging during metadata upda...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1509 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3740) Add configs for RocksDBStores

[ https://issues.apache.org/jira/browse/KAFKA-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334812#comment-15334812 ] Roger Hoover commented on KAFKA-3740: - [~h...@pinterest.com], any update on this? I'm wondering if

Re: [DISCUSS] Java 8 as a minimum requirement

Hi Ismael, Unfortunately Java 8 doesn't play nice with FreeBSD. We have seen a lot of JVM crashes running our 0.9 brokers on Java 8... Java 7 on the other hand is totally stable. Until these issues have been addressed, this would cause some serious issues for us. Regards Jan

Re: [DISCUSS] Java 8 as a minimum requirement

Hi Jan, That's interesting. Do you have some references you can share on this? It would be good to know which Java 8 versions have been tested and whether it is something that is being worked on. Ismael On Fri, Jun 17, 2016 at 12:02 AM, wrote: > > Hi Ismael, > >

[jira] [Commented] (KAFKA-2720) Periodic purging groups in the coordinator

[ https://issues.apache.org/jira/browse/KAFKA-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334787#comment-15334787 ] ASF GitHub Bot commented on KAFKA-2720: --- Github user asfgit closed the pull request at:

Reg: Build Validation Jenkins

Hi, I have opened pull request for one of the JIRA. My build has been marked has failed due to time out exception. I think configuration setup is like that after 2 hours mark it as build fail. I have seen other builds on jenkins they also has same issue. Is this jenkins server executing machines

[jira] [Commented] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334768#comment-15334768 ] ASF GitHub Bot commented on KAFKA-3837: --- GitHub user bharatviswa504 opened a pull request:

[GitHub] kafka pull request #1516: KAFKA-3837: Report the thread name of the blocking...

GitHub user bharatviswa504 opened a pull request: https://github.com/apache/kafka/pull/1516 KAFKA-3837: Report the thread name of the blocking thread when throwing ConcurrentModificationException You can merge this pull request into a Git repository by running: $ git pull

[VOTE] KIP-4 Create Topics Schema

I would like to initiate the voting process for the "KIP-4 Create Topics Schema changes". This is not a vote for all of KIP-4, but specifically for the create topics changes. I have included the exact changes below for clarity: > > Create Topics Request (KAFKA-2945 >

Re: FYI - Apache ZooKeeper Backup, a Treatise

Hi Jordan, Kafka stores ACLs as well as client and topic configs in ZooKeeper so that lends credence to your argument, I think. Ismael On Thu, Jun 16, 2016 at 11:41 PM, Jordan Zimmerman < jor...@jordanzimmerman.com> wrote: > Contrary to recommendations everywhere, my experience is that almost

Re: FYI - Apache ZooKeeper Backup, a Treatise

Contrary to recommendations everywhere, my experience is that almost everyone is storing source of truth data in ZooKeeper. It’s just too tempting. You have a distributed file system just sitting there and it’s too easy to use. You get a lot of great features like watches, etc. People are using

Re: [DISCUSS] Java 8 as a minimum requirement

+1 On Thu, Jun 16, 2016 at 5:05 PM, Philippe Derome wrote: > I strongly support motion having difficulty running (Apache Kafka as > opposed to Confluent) Stream examples with JDK 8 today. > On 16 Jun 2016 4:46 p.m., "Ismael Juma" wrote: > > > Hi all, > >

Re: [DISCUSS] Java 8 as a minimum requirement

@Jeff Klukas What is the concern about scala 2.11 vs 2.12? 2.11 runs on both java7 and java8 2016-06-16 14:12 GMT-07:00 Jeff Klukas : > Would the move to Java 8 be for all modules? I'd have some concern about > removing Java 7 compatibility for kafka-clients and for kafka

Re: [DISCUSS] Java 8 as a minimum requirement

Hi Grant, Comments below. On Thu, Jun 16, 2016 at 11:13 PM, Grant Henke wrote: > Would it make sense to drop Java 1.7 and Scala 2.10 support in Kafka 0.11 > to maintain upgrade compatibility throughout the 0.10.x series? > The issue is that we don't know when Kafka 0.11

[jira] [Updated] (KAFKA-3837) Report the name of the blocking thread when throwing ConcurrentModificationException

[ https://issues.apache.org/jira/browse/KAFKA-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated KAFKA-3837: -- Status: Patch Available (was: In Progress) > Report the name of the blocking thread

Build failed in Jenkins: kafka-trunk-jdk7 #1369

See Changes: [wangguoz] KAFKA-3561: Auto create through topic for KStream aggregation and join -- [...truncated 10553 lines...] org.apache.kafka.common.config.ConfigDefTest > testValidate

Re: [DISCUSS] Java 8 as a minimum requirement

On Thu, Jun 16, 2016 at 11:13 PM, Stephen Boesch wrote: > @Jeff Klukas What is the concern about scala 2.11 vs 2.12? 2.11 runs on > both java7 and java8 > Scala 2.10.5 and 2.10.6 also support Java 8 for what it's worth. Ismael

[jira] [Updated] (KAFKA-3858) Add functions to print stream topologies

[ https://issues.apache.org/jira/browse/KAFKA-3858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska updated KAFKA-3858: Affects Version/s: (was: 0.10.0.0) 0.10.1.0 > Add functions to print

[jira] [Assigned] (KAFKA-3858) Add functions to print stream topologies

[ https://issues.apache.org/jira/browse/KAFKA-3858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reassigned KAFKA-3858: --- Assignee: Eno Thereska (was: Guozhang Wang) > Add functions to print stream topologies >

Re: [DISCUSS] Java 8 as a minimum requirement

+1 for lambda expressions On Thu, Jun 16, 2016 at 5:13 PM, Grant Henke wrote: > I definitely think its time, but I am not sure if 0.10.1.0 is the release > version to drop support in. > > Would it make sense to drop Java 1.7 and Scala 2.10 support in Kafka 0.11 > to

Re: [DISCUSS] Java 8 as a minimum requirement

I definitely think its time, but I am not sure if 0.10.1.0 is the release version to drop support in. Would it make sense to drop Java 1.7 and Scala 2.10 support in Kafka 0.11 to maintain upgrade compatibility throughout the 0.10.x series? As a side note, I personally like the pattern of always

Re: [DISCUSS] Java 8 as a minimum requirement

Would the move to Java 8 be for all modules? I'd have some concern about removing Java 7 compatibility for kafka-clients and for kafka streams (though less so since it's still so new). I don't know how hard it will be to transition a Scala 2.11 application to Scala 2.12. Are we comfortable with

Re: avro-console-producer issue for Kafka Stream example PageViewRegionLambdaExample

Sorry, this thread belongs to confluent not Kafka.apache.org as it pertains to Confluent's examples. On Thu, Jun 16, 2016 at 2:33 PM, Philippe Derome wrote: > I am able to produce Avro from producer for pageview.avsc but not for > userprofile.avsc. Here are two samples

[jira] [Created] (KAFKA-3858) Add functions to print stream topologies

Roger Hoover created KAFKA-3858: --- Summary: Add functions to print stream topologies Key: KAFKA-3858 URL: https://issues.apache.org/jira/browse/KAFKA-3858 Project: Kafka Issue Type: New Feature

Re: [DISCUSS] Java 8 as a minimum requirement

I strongly support motion having difficulty running (Apache Kafka as opposed to Confluent) Stream examples with JDK 8 today. On 16 Jun 2016 4:46 p.m., "Ismael Juma" wrote: > Hi all, > > I would like to start a discussion on making Java 8 a minimum requirement > for Kafka's

Re: [DISCUSS] Java 8 as a minimum requirement

+1 On Thu, Jun 16, 2016 at 1:45 PM, Ismael Juma wrote: > Hi all, > > I would like to start a discussion on making Java 8 a minimum requirement > for Kafka's next feature release (let's say Kafka 0.10.1.0 for now). This > is the first discussion on the topic so the idea is to

Re: [DISCUSS] Java 8 as a minimum requirement

+1 Adam Kunicki StreamSets | Field Engineer mobile: 415.890.DATA (3282) | linkedin On Thu, Jun 16, 2016 at 1:56 PM, Craig Swift < craig.sw...@returnpath.com.invalid>

Re: [DISCUSS] Java 8 as a minimum requirement

+1 Craig J. Swift Principal Software Engineer - Data Pipeline ReturnPath Inc. Work: 303-999-3220 Cell: 720-560-7038 On Thu, Jun 16, 2016 at 2:50 PM, Henry Cai wrote: > +1 for Lambda expression. > > On Thu, Jun 16, 2016 at 1:48 PM, Rajiv Kurian

Re: [DISCUSS] Java 8 as a minimum requirement

+ 1 On Thursday, 16 June 2016, Craig Swift wrote: > +1 > > Craig J. Swift > Principal Software Engineer - Data Pipeline > ReturnPath Inc. > Work: 303-999-3220 Cell: 720-560-7038 > > On Thu, Jun 16, 2016 at 2:50 PM, Henry Cai >

Re: [DISCUSS] Java 8 as a minimum requirement

+1 for Lambda expression. On Thu, Jun 16, 2016 at 1:48 PM, Rajiv Kurian wrote: > +1 > > On Thu, Jun 16, 2016 at 1:45 PM, Ismael Juma wrote: > > > Hi all, > > > > I would like to start a discussion on making Java 8 a minimum requirement > > for Kafka's

Re: Embedding zookeeper and kafka in java process.

Try using kafka.server.KafkaServerStartable instead. It should do the right thing. Ismael On Thu, Jun 16, 2016 at 7:18 PM, Subhash Agrawal wrote: > Thanks Ismael. > I am instantiating kafkaserver instance like this. > new KafkaServer(kafkaConfig,null,null); > > I tried

[DISCUSS] Java 8 as a minimum requirement

Hi all, I would like to start a discussion on making Java 8 a minimum requirement for Kafka's next feature release (let's say Kafka 0.10.1.0 for now). This is the first discussion on the topic so the idea is to understand how people feel about it. If people feel it's too soon, then we can pick up

Build failed in Jenkins: kafka-trunk-jdk8 #702

See Changes: [wangguoz] KAFKA-3561: Auto create through topic for KStream aggregation and join -- [...truncated 6592 lines...] kafka.utils.ByteBoundedBlockingQueueTest >

[jira] [Updated] (KAFKA-3849) Make consumer poll time in MirrorMaker configurable.

[ https://issues.apache.org/jira/browse/KAFKA-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-3849: -- Status: Patch Available (was: Open) > Make consumer poll time in MirrorMaker configurable. >

[jira] [Commented] (KAFKA-3849) Make consumer poll time in MirrorMaker configurable.

[ https://issues.apache.org/jira/browse/KAFKA-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334531#comment-15334531 ] ASF GitHub Bot commented on KAFKA-3849: --- GitHub user SinghAsDev opened a pull request:

[GitHub] kafka pull request #1515: KAFKA-3849: Make consumer poll time in MirrorMaker...

GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/1515 KAFKA-3849: Make consumer poll time in MirrorMaker configurable You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAsDev/kafka KAFKA-3849

[jira] [Commented] (KAFKA-789) Producer-side persistence for delivery guarantee

[ https://issues.apache.org/jira/browse/KAFKA-789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334523#comment-15334523 ] radha commented on KAFKA-789: - This says resolved but does not mention anything about how this works? >

Re: FYI - Apache ZooKeeper Backup, a Treatise

Yes, thank you to Jordan for the article! Like Flavio, I personally have never come across the requirement for ZooKeeper backups. I've generally followed the pattern that data stored in ZooKeeper is truly transient, and applications are built either to tolerate loss of that data or reconstruct

[jira] [Created] (KAFKA-3857) Additional log cleaner metrics

Kiran Pillarisetty created KAFKA-3857: - Summary: Additional log cleaner metrics Key: KAFKA-3857 URL: https://issues.apache.org/jira/browse/KAFKA-3857 Project: Kafka Issue Type:

[GitHub] kafka pull request #1514: MINOR: Mention `log.message.format.version=0.10.0`...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1514 MINOR: Mention `log.message.format.version=0.10.0` in rolling upgrade section We had mentioned this step in the performance impact section in the middle of a long paragraph, which made it easy to

[jira] [Commented] (KAFKA-3561) Auto create through topic for KStream aggregation and join

[ https://issues.apache.org/jira/browse/KAFKA-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334446#comment-15334446 ] ASF GitHub Bot commented on KAFKA-3561: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-3561) Auto create through topic for KStream aggregation and join

[ https://issues.apache.org/jira/browse/KAFKA-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3561. -- Resolution: Fixed Issue resolved by pull request 1472

[GitHub] kafka pull request #1472: KAFKA-3561: Auto create through topic for KStream ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1472 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (KAFKA-3856) Move inner classes accessible only functions in TopologyBuilder out of public APIs

Guozhang Wang created KAFKA-3856: Summary: Move inner classes accessible only functions in TopologyBuilder out of public APIs Key: KAFKA-3856 URL: https://issues.apache.org/jira/browse/KAFKA-3856

[jira] [Created] (KAFKA-3855) Guard race conditions in TopologyBuilder

Guozhang Wang created KAFKA-3855: Summary: Guard race conditions in TopologyBuilder Key: KAFKA-3855 URL: https://issues.apache.org/jira/browse/KAFKA-3855 Project: Kafka Issue Type: Bug

[VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

Hi All, I'd like to open the vote for KIP-62. This proposal attempts to address one of the recurring usability problems that users of the new consumer have faced with as little impact as possible. You can read the full details here:

avro-console-producer issue for Kafka Stream example PageViewRegionLambdaExample

I am able to produce Avro from producer for pageview.avsc but not for userprofile.avsc. Here are two samples below, first one leaves out Avro optional experience, second one specifies it. Note: I do not register using REST curl calls schemas to schema-registry as I assume that

[jira] [Created] (KAFKA-3854) Consecutive regex subscription calls fail

Vahid Hashemian created KAFKA-3854: -- Summary: Consecutive regex subscription calls fail Key: KAFKA-3854 URL: https://issues.apache.org/jira/browse/KAFKA-3854 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334223#comment-15334223 ] Vahid Hashemian commented on KAFKA-3144: This improvement request was moved to its own JIRA

RE: Embedding zookeeper and kafka in java process.

Thanks Ismael. I am instantiating kafkaserver instance like this. new KafkaServer(kafkaConfig,null,null); I tried to use new KafkaServer(kafkaConfig); but it does not compile with kafka 0.10.0. All the example I see uses new KafkaServer(kafkaConfig); Do we support new

[jira] [Created] (KAFKA-3853) Report offsets for empty groups in ConsumerGroupCommand

Jason Gustafson created KAFKA-3853: -- Summary: Report offsets for empty groups in ConsumerGroupCommand Key: KAFKA-3853 URL: https://issues.apache.org/jira/browse/KAFKA-3853 Project: Kafka

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334216#comment-15334216 ] Vahid Hashemian commented on KAFKA-3144: Thanks [~hachikuji]. > report members with no assigned

[jira] [Commented] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334175#comment-15334175 ] Jason Gustafson commented on KAFKA-3144: Haha, yeah. Should have known that Jun would already have

[jira] [Comment Edited] (KAFKA-3144) report members with no assigned partitions in ConsumerGroupCommand

[ https://issues.apache.org/jira/browse/KAFKA-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334161#comment-15334161 ] Vahid Hashemian edited comment on KAFKA-3144 at 6/16/16 5:05 PM: -

[jira] [Commented] (KAFKA-2720) Periodic purging groups in the coordinator

[ https://issues.apache.org/jira/browse/KAFKA-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334164#comment-15334164 ] ASF GitHub Bot commented on KAFKA-2720: --- GitHub user hachikuji opened a pull request:

[GitHub] kafka pull request #1513: MINOR: Follow-up from KAFKA-2720 with comment/styl...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1513 MINOR: Follow-up from KAFKA-2720 with comment/style fixes You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka

[jira] [Updated] (KAFKA-3851) Add references to important installation/upgrade notes to release notes

[ https://issues.apache.org/jira/browse/KAFKA-3851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3851: - Affects Version/s: 0.10.0.0 > Add references to important installation/upgrade

[jira] [Created] (KAFKA-3852) Clarify how to handle message format upgrade without killing performance

Ewen Cheslack-Postava created KAFKA-3852: Summary: Clarify how to handle message format upgrade without killing performance Key: KAFKA-3852 URL: https://issues.apache.org/jira/browse/KAFKA-3852

[jira] [Created] (KAFKA-3851) Add references to important installation/upgrade notes to release notes

Ewen Cheslack-Postava created KAFKA-3851: Summary: Add references to important installation/upgrade notes to release notes Key: KAFKA-3851 URL: https://issues.apache.org/jira/browse/KAFKA-3851

Re: [DISCUSS] KIP-4 Create Topic Schema

I have updated the wiki and pull request based on the feedback. If there are no objections I will start a vote at the end of the day. Details for this implementation can be read here:

  1   2   >