Re: [DISCUSS] KIP-80: Kafka REST Server

2016-10-07 Thread Michael Pearce
+1 I agree on the governance comments whole heartedly. Also i agree about the contribution comments made earlier in the thread, i personally am less likely to spend any of mine, or give project time within my internal projects to developers contributing to another commercial companies project

Re: [DISCUSS] KIP-82 - Add Record Headers

2016-10-07 Thread Michael Pearce
>> I agree with the critique of compaction not having a value. I think we >> should consider fixing that directly. > Agree that the compaction issue is troubling: compacted "null" deletes are incompatible w/ headers that must be packed into the message value. Are there any alternatives on compact

Build failed in Jenkins: kafka-0.10.1-jdk7 #56

2016-10-07 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4274; Consumer `offsetForTimes` times out on empty map -- [...truncated 7141 lines...] kafka.server.ServerGenerateBrokerIdTest > testMultipleLogDirsMetaProps STARTED k

Build failed in Jenkins: kafka-trunk-jdk7 #1612

2016-10-07 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4274; Consumer `offsetForTimes` times out on empty map -- [...truncated 1093 lines...] kafka.utils.ReplicationUtilsTest > testGetLeaderIsrAndEpochForPartition PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #957

2016-10-07 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4274; Consumer `offsetForTimes` times out on empty map -- [...truncated 1093 lines...] kafka.utils.ReplicationUtilsTest > testUpdateLeaderAndIsr STARTED kafka.utils.Re

Re: [DISCUSS] KIP-47 - Add timestamp-based log deletion policy

2016-10-07 Thread Becket Qin
Hi Bill, I saw the voting thread and think it may be better to discuss this in the discussion thread. It would be good to have the KIP wiki to clarify the behavior when log.retention.ms, log.retention.bytes and log.retention.min.timestamp are all set. For example, if the size of the partition has

[jira] [Resolved] (KAFKA-4274) KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4274. Resolution: Fixed Issue resolved by pull request 1993 [https://github.com/apache/kafka/pull/

[jira] [Commented] (KAFKA-4274) KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

2016-10-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556903#comment-15556903 ] ASF GitHub Bot commented on KAFKA-4274: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1993: KAFKA-4274: offsetsForTimes() hang on empty map.

2016-10-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1993 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk7 #1611

2016-10-07 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: recreate state.dir after cleanup -- [...truncated 7844 lines...] kafka.integration.SslTopicMetadataTest > testAliveBrokersListWithNoTopicsAfterNewBrokerStartup

[jira] [Created] (KAFKA-4276) REST configuration not visible in connector properties config files

2016-10-07 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-4276: --- Summary: REST configuration not visible in connector properties config files Key: KAFKA-4276 URL: https://issues.apache.org/jira/browse/KAFKA-4276 Project: Kafka

Re: [DISCUSS] KIP-80: Kafka REST Server

2016-10-07 Thread Andrew Schofield
There's a massive difference between the governance of Kafka and the governance of the REST proxy. In Kafka, there is a broad community of people contributing their opinions about future enhancements in the form of KIPs. There's some really deep consideration that goes into some of the trickier

[jira] [Commented] (KAFKA-3410) Unclean leader election and "Halting because log truncation is not allowed"

2016-10-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556670#comment-15556670 ] Jun Rao commented on KAFKA-3410: [~james cheng], the proposal in KAFKA-1211 should prevent

Re: [DISCUSS] KIP-82 - Add Record Headers

2016-10-07 Thread Nacho Solis
On Fri, Oct 7, 2016 at 8:45 AM, Jay Kreps wrote: > This discussion has come up a number of times and we've always passed. > ​Hopefully this time the arguments will be convincing enough that Kafka can decide to do something about it. ​ > One of things that has helped keep Kafka simple is not a

Re: [VOTE] 0.10.1.0 RC0

2016-10-07 Thread Jason Gustafson
Quick update: I'm planning to cut a new RC on Monday due to https://issues.apache.org/jira/browse/KAFKA-4274. If you discover any new problems in the meantime, let me know on this thread. Thanks, Jason On Fri, Oct 7, 2016 at 9:36 AM, Vahid S Hashemian wrote: > Jason, > > Sure, I'll submit a pat

[jira] [Commented] (KAFKA-4274) KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

2016-10-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556565#comment-15556565 ] ASF GitHub Bot commented on KAFKA-4274: --- GitHub user becketqin opened a pull request

[GitHub] kafka pull request #1993: KAFKA-4274: offsetsForTimes() hang on empty map.

2016-10-07 Thread becketqin
GitHub user becketqin opened a pull request: https://github.com/apache/kafka/pull/1993 KAFKA-4274: offsetsForTimes() hang on empty map. You can merge this pull request into a Git repository by running: $ git pull https://github.com/becketqin/kafka KAFKA-4274 Alternatively you

[jira] [Commented] (KAFKA-4274) KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

2016-10-07 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556529#comment-15556529 ] Jiangjie Qin commented on KAFKA-4274: - [~junrao] Thanks for reporting the issue. Will

[jira] [Assigned] (KAFKA-4274) KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

2016-10-07 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned KAFKA-4274: --- Assignee: Jiangjie Qin > KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

Re: [DISCUSS] KIP-84: Support SASL/SCRAM mechanisms

2016-10-07 Thread Gwen Shapira
Can you talk more about rejecting the option of making the password store pluggable? I am a bit uncomfortable with making ZK the one and only password store... On Tue, Oct 4, 2016 at 6:43 AM, Rajini Sivaram wrote: > Hi all, > > I have just created KIP-84 to add SCRAM-SHA-1 and SCRAM-SHA-256 SASL

Re: [VOTE] KIP-47 - Add timestamp-based log deletion policy

2016-10-07 Thread Gwen Shapira
+1 (binding) On Wed, Oct 5, 2016 at 1:55 PM, Bill Warshaw wrote: > Bumping for visibility. KIP is here: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-47+-+Add+timestamp-based+log+deletion+policy > > On Wed, Aug 24, 2016 at 2:32 PM Bill Warshaw wrote: > >> Hello Guozhang, >> >> KIP-71

[jira] [Updated] (KAFKA-4275) Check of State-Store-assignment to Processor-Nodes is not enabled

2016-10-07 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4275: --- Status: Patch Available (was: In Progress) > Check of State-Store-assignment to Processor-Nod

Re: [DISCUSS] KIP-85: Dynamic JAAS configuration for Kafka clients

2016-10-07 Thread Gwen Shapira
Huge +1. Thank you Rajini for all the hard work on security improvements. With more Docker deployments of micro-services, getting rid of mandatory config file will be super important. Gwen On Thu, Oct 6, 2016 at 5:43 AM, Edoardo Comar wrote: > Hi Rajini > great improvement and I see you had the

[jira] [Commented] (KAFKA-4275) Check of State-Store-assignment to Processor-Nodes is not enabled

2016-10-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556448#comment-15556448 ] ASF GitHub Bot commented on KAFKA-4275: --- GitHub user mjsax opened a pull request:

[GitHub] kafka pull request #1992: KAFKA-4275: Check of State-Store-assignment to Pro...

2016-10-07 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/1992 KAFKA-4275: Check of State-Store-assignment to Processor-Nodes is not enabled You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka kafka-4

Re: [DISCUSS] KIP-82 - Add Record Headers

2016-10-07 Thread Dana Powers
> I agree with the critique of compaction not having a value. I think we should > consider fixing that directly. Agree that the compaction issue is troubling: compacted "null" deletes are incompatible w/ headers that must be packed into the message value. Are there any alternatives on compaction

[jira] [Resolved] (KAFKA-3302) Pass kerberos keytab and principal as part of client config

2016-10-07 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-3302. - Resolution: Duplicate Closing as duplicate since Rajini already has a PR out. > Pass kerberos key

[jira] [Commented] (KAFKA-4217) KStream.transform equivalent of flatMap

2016-10-07 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556371#comment-15556371 ] Elias Levy commented on KAFKA-4217: --- That would work as well. > KStream.transform equiv

Build failed in Jenkins: kafka-trunk-jdk8 #956

2016-10-07 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: move restoreConsumer.assign() to shutdownTasksAndState [wangguoz] HOTFIX: recreate state.dir after cleanup -- [...truncated 5086 lines...] kafka.utils.Replicatio

[jira] [Updated] (KAFKA-4117) Cleanup StreamPartitionAssignor behavior

2016-10-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4117: - Description: I went through the whole assignment logic once again and I feel the logic has now be

[jira] [Commented] (KAFKA-4217) KStream.transform equivalent of flatMap

2016-10-07 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556349#comment-15556349 ] Matthias J. Sax commented on KAFKA-4217: Would it not be simpler to change `proces

Jenkins build is back to normal : kafka-0.10.1-jdk7 #55

2016-10-07 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-80: Kafka REST Server

2016-10-07 Thread Suresh Srinivas
ASF already gives us a clear framework and governance model for community development. This is already understood by the people contributing to Apache Kafka project, and they are the same people who want to contribute to the REST server capability as well. Everyone is in agreement on the need for c

[jira] [Work started] (KAFKA-4275) Check of State-Store-assignment to Processor-Nodes is not enabled

2016-10-07 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4275 started by Matthias J. Sax. -- > Check of State-Store-assignment to Processor-Nodes is not enabled > ---

[jira] [Created] (KAFKA-4275) Check of State-Store-assignment to Processor-Nodes is not enabled

2016-10-07 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-4275: -- Summary: Check of State-Store-assignment to Processor-Nodes is not enabled Key: KAFKA-4275 URL: https://issues.apache.org/jira/browse/KAFKA-4275 Project: Kafka

[jira] [Updated] (KAFKA-4274) KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4274: --- Fix Version/s: 0.10.1.0 > KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

Jenkins build is back to normal : kafka-trunk-jdk7 #1610

2016-10-07 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-4271) The console consumer fails on Windows with new consumer is used

2016-10-07 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556219#comment-15556219 ] Vahid Hashemian commented on KAFKA-4271: The command {{bin\windows\kafka-run-class

[jira] [Commented] (KAFKA-4274) KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

2016-10-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556217#comment-15556217 ] Jun Rao commented on KAFKA-4274: [~becket_qin], do you want to fix this? Thanks. > KafkaC

[jira] [Created] (KAFKA-4274) KafkaConsumer.offsetsForTimes() hangs and times out on an empty map

2016-10-07 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-4274: -- Summary: KafkaConsumer.offsetsForTimes() hangs and times out on an empty map Key: KAFKA-4274 URL: https://issues.apache.org/jira/browse/KAFKA-4274 Project: Kafka Issue

Re: [DISCUSS] KIP-82 - Add Record Headers

2016-10-07 Thread Michael Pearce
Hi Jay, Thanks for the comments and feedback. I think its quite clear that if a problem keeps arising then it is clear that it needs resolving, and addressing properly. Fair enough at linkedIn, and historically for the very first use cases addressing this maybe not have been a big priority. B

[GitHub] kafka pull request #1940: HOTFIX: recreate state.dir after cleanup

2016-10-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1940 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4273) Streams DSL - Add TTL / retention period support for intermediate topics and state stores

2016-10-07 Thread Davor Poldrugo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Poldrugo updated KAFKA-4273: -- Description: Hi! I'm using Streams DSL (0.10.0.1), which can only use RocksDB for local state as

[jira] [Updated] (KAFKA-4273) Streams DSL - Add TTL / retention period support for intermediate topics and state stores

2016-10-07 Thread Davor Poldrugo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Poldrugo updated KAFKA-4273: -- Description: Hi! I'm using Streams DSL (0.10.0.1), which can only use RocksDB for local state as

[jira] [Created] (KAFKA-4273) Streams DSL - Add TTL / retention period support for intermediate topics and state stores

2016-10-07 Thread Davor Poldrugo (JIRA)
Davor Poldrugo created KAFKA-4273: - Summary: Streams DSL - Add TTL / retention period support for intermediate topics and state stores Key: KAFKA-4273 URL: https://issues.apache.org/jira/browse/KAFKA-4273

Re: [DISCUSS] KIP-80: Kafka REST Server

2016-10-07 Thread Neha Narkhede
Harsha/Mani, I completely agree that adding admin API support and security are important features for the Kafka REST proxy. Luckily the roadmap items that you mentioned as being important for a Kafka REST proxy server are exactly the ones the community working on this REST proxy want to add to it

Build failed in Jenkins: kafka-trunk-jdk8 #955

2016-10-07 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on jenkins-test-39e (Ubuntu ubuntu jenkins-cloud-8GB jenkins-cloud-4GB cloud-slave) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #954

2016-10-07 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Use `hiResClockMs` in `testRequestExpiry` to fix transient test -- [...truncated 14017 lines...] org.apache.kafka.streams.state.internals.CompositeReadOnlyKeyValueSto

Build failed in Jenkins: kafka-0.10.1-jdk7 #54

2016-10-07 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on jenkins-test-39e (Ubuntu ubuntu jenkins-cloud-8GB jenkins-cloud-4GB cloud-slave) in workspace

Re: [DISCUSS] KIP-80: Kafka REST Server

2016-10-07 Thread Harsha Chintalapani
Ofir, … " personally think it would be quite wasteful to re-implement the REST gateway just because that an actively-maintained piece of Apache-licensed software is not governed directly by the Apache Kafka community... While kafka-rest repo is owned by Confluent, the contributors including the

Build failed in Jenkins: kafka-trunk-jdk7 #1609

2016-10-07 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on jenkins-test-39e (Ubuntu ubuntu jenkins-cloud-8GB jenkins-cloud-4GB cloud-slave) in workspace

Re: [DISCUSS] KIP-80: Kafka REST Server

2016-10-07 Thread Harsha Ch
Ofir, " personally think it would be quite wasteful to re-implement the REST gateway just because that an actively-maintained piece of Apache-licensed software is not governed directly by the Apache Kafka community... While kafka-rest repo is owned by Confluent, the contributors including the m

Jenkins build is back to normal : kafka-trunk-jdk7 #1608

2016-10-07 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-4272) Kafka Connect batch scripts are missing under `bin/windows/`

2016-10-07 Thread Vahid Hashemian (JIRA)
Vahid Hashemian created KAFKA-4272: -- Summary: Kafka Connect batch scripts are missing under `bin/windows/` Key: KAFKA-4272 URL: https://issues.apache.org/jira/browse/KAFKA-4272 Project: Kafka

[GitHub] kafka pull request #1986: HOTFIX: move restoreConsumer.assign() to shutdownT...

2016-10-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1986 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Created] (KAFKA-4271) The console consumer fails on Windows with new consumer is used

2016-10-07 Thread Vahid Hashemian (JIRA)
Vahid Hashemian created KAFKA-4271: -- Summary: The console consumer fails on Windows with new consumer is used Key: KAFKA-4271 URL: https://issues.apache.org/jira/browse/KAFKA-4271 Project: Kafka

[jira] [Resolved] (KAFKA-4257) Inconsistencies in 0.10.1 upgrade docs

2016-10-07 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas resolved KAFKA-4257. Resolution: Fixed Ismael's PR addresses these questions. > Inconsistencies in 0.10.1 upgrade docs

[jira] [Updated] (KAFKA-4265) Intermittent test failure ReplicationQuotasTest.shouldBootstrapTwoBrokersWithFollowerThrottle

2016-10-07 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-4265: -- Description: https://builds.apache.org/job/kafka-trunk-git-pr-jdk7/6085/testReport/junit/kafka.s

[jira] [Commented] (KAFKA-4265) Intermittent test failure ReplicationQuotasTest.shouldBootstrapTwoBrokersWithFollowerThrottle

2016-10-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1779#comment-1779 ] ASF GitHub Bot commented on KAFKA-4265: --- GitHub user rajinisivaram opened a pull req

[GitHub] kafka pull request #1991: KAFKA-4265: Run replication quotas test with produ...

2016-10-07 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/1991 KAFKA-4265: Run replication quotas test with producer acks=1 Test expects all records to be published successfully, which cannot be guaranteed with acks=0 since failures are not retried. You

Build failed in Jenkins: kafka-0.10.1-jdk7 #53

2016-10-07 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Use `hiResClockMs` in `testRequestExpiry` to fix transient test -- [...truncated 1120 lines...] kafka.utils.timer.TimerTest > testTaskExpiration PASSED kafka.utils.ti

[GitHub] kafka pull request #1990: MINOR: Update Quickstart in documentation to accou...

2016-10-07 Thread vahidhashemian
GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/1990 MINOR: Update Quickstart in documentation to account for Windows platforms You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian

[jira] [Commented] (KAFKA-4257) Inconsistencies in 0.10.1 upgrade docs

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1692#comment-1692 ] Jason Gustafson commented on KAFKA-4257: [~jeff.klu...@gmail.com] Can we resolve t

[jira] [Commented] (KAFKA-4217) KStream.transform equivalent of flatMap

2016-10-07 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1654#comment-1654 ] Elias Levy commented on KAFKA-4217: --- It would seem to be the same request: allow a trans

[jira] [Updated] (KAFKA-1629) Replica fetcher thread need to back off upon getting errors on partitions

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1629: --- Fix Version/s: (was: 0.10.1.0) > Replica fetcher thread need to back off upon getting erro

[jira] [Updated] (KAFKA-1183) DefaultEventHandler causes unbalanced distribution of messages across partitions

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1183: --- Fix Version/s: (was: 0.10.1.0) (was: 0.8.1) > DefaultEventHandler c

[jira] [Updated] (KAFKA-1255) Offset in RecordMetadata is Incorrect with New Producer Ack = -1

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1255: --- Fix Version/s: (was: 0.10.1.0) > Offset in RecordMetadata is Incorrect with New Producer A

Build failed in Jenkins: kafka-0.10.1-jdk7 #52

2016-10-07 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-4262; Increase data volume in replication test -- [...truncated 3832 lines...] kafka.coordinator.GroupCoordinatorResponseTest > testSyncGroupLeaderAfterFollower STAR

[jira] [Updated] (KAFKA-1592) Some INFO level logging needs to be DEBUG

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1592: --- Fix Version/s: (was: 0.10.1.0) > Some INFO level logging needs to be DEBUG > -

[jira] [Updated] (KAFKA-1554) Corrupt index found on clean startup

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1554: --- Fix Version/s: (was: 0.10.0.0) (was: 0.10.1.0) > Corrupt index foun

[jira] [Updated] (KAFKA-2658) Implement SASL/PLAIN

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2658: --- Fix Version/s: (was: 0.10.0.0) (was: 0.10.1.0) > Implement SASL/PLA

Build failed in Jenkins: kafka-trunk-jdk7 #1607

2016-10-07 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-4267; Quota initialization for uses incorrect ZK -- [...truncated 12106 lines...] org.apache.kafka.clients.producer.internals.SenderTest > testSendInOrder PASSED o

[jira] [Updated] (KAFKA-3511) Add common aggregation functions like Sum and Avg as build-ins in Kafka Streams DSL

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3511: --- Fix Version/s: (was: 0.10.1.0) > Add common aggregation functions like Sum and Avg as buil

[jira] [Updated] (KAFKA-777) Add system tests for important tools

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-777: -- Fix Version/s: (was: 0.10.1.0) > Add system tests for important tools > -

[jira] [Updated] (KAFKA-1589) Strengthen System Tests

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1589: --- Fix Version/s: (was: 0.10.1.0) > Strengthen System Tests > --- > >

[jira] [Updated] (KAFKA-478) Move start_consumer & start_producer inside "start_entity_in_background"

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-478: -- Fix Version/s: (was: 0.10.1.0) > Move start_consumer & start_producer inside "start_entity_in

[jira] [Updated] (KAFKA-564) Wildcard-based topic consumption should assign partitions to threads uniformly

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-564: -- Fix Version/s: (was: 0.10.1.0) > Wildcard-based topic consumption should assign partitions to

[jira] [Updated] (KAFKA-288) java impacted changes from new producer and consumer request format

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-288: -- Fix Version/s: (was: 0.10.1.0) > java impacted changes from new producer and consumer request

[jira] [Updated] (KAFKA-558) KafkaETLContext should use getTopicMetadata before sending offset requests

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-558: -- Fix Version/s: (was: 0.10.1.0) > KafkaETLContext should use getTopicMetadata before sending o

[jira] [Updated] (KAFKA-289) reuse topicdata when sending producerrequest

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-289: -- Fix Version/s: (was: 0.10.1.0) > reuse topicdata when sending producerrequest > -

[jira] [Updated] (KAFKA-3637) Add method that checks if streams are initialised

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3637: --- Fix Version/s: (was: 0.10.1.0) > Add method that checks if streams are initialised > -

[jira] [Updated] (KAFKA-3873) Gradle Test Executor non-zero exit code when running streams tests

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3873: --- Fix Version/s: (was: 0.10.1.0) > Gradle Test Executor non-zero exit code when running stre

[jira] [Updated] (KAFKA-3759) Incorrect JDBC credentials cause Connect worker to permanently fail

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3759: --- Fix Version/s: (was: 0.10.1.0) > Incorrect JDBC credentials cause Connect worker to perman

[jira] [Updated] (KAFKA-2901) Extend ListGroups and DescribeGroup APIs to cover offsets

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2901: --- Fix Version/s: (was: 0.10.1.0) > Extend ListGroups and DescribeGroup APIs to cover offsets

[jira] [Updated] (KAFKA-3183) Add metrics for persistent store caching layer

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3183: --- Fix Version/s: (was: 0.10.1.0) > Add metrics for persistent store caching layer >

[jira] [Updated] (KAFKA-3101) Optimize Aggregation Outputs

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3101: --- Fix Version/s: (was: 0.10.1.0) > Optimize Aggregation Outputs > --

[jira] [Updated] (KAFKA-3913) Old consumer's metrics error when using IPv6

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3913: --- Fix Version/s: (was: 0.10.1.0) > Old consumer's metrics error when using IPv6 > -

[jira] [Updated] (KAFKA-4074) Deleting a topic can make it unavailable even if delete.topic.enable is false

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4074: --- Fix Version/s: (was: 0.10.1.0) > Deleting a topic can make it unavailable even if delete.t

[jira] [Updated] (KAFKA-1324) Debian packaging

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1324: --- Fix Version/s: (was: 0.10.1.0) > Debian packaging > > > K

[jira] [Updated] (KAFKA-1613) Improve system test documentation

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1613: --- Fix Version/s: (was: 0.10.1.0) > Improve system test documentation > -

[jira] [Updated] (KAFKA-3801) Provide static serialize() and deserialize() for use as method references

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3801: --- Fix Version/s: (was: 0.10.1.0) > Provide static serialize() and deserialize() for use as m

[jira] [Updated] (KAFKA-789) Producer-side persistence for delivery guarantee

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-789: -- Fix Version/s: (was: 0.10.1.0) > Producer-side persistence for delivery guarantee > -

[jira] [Updated] (KAFKA-1040) ConsumerConfig and ProducerConfig do "work" in the Constructor

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-1040: --- Fix Version/s: (was: 0.10.1.0) > ConsumerConfig and ProducerConfig do "work" in the Constr

Re: [VOTE] 0.10.1.0 RC0

2016-10-07 Thread Vahid S Hashemian
Jason, Sure, I'll submit a patch for the trivial changes in the quick start. Do you recommend adding Windows version of commands along with the current commands? I'll also open a JIRA for the new consumer issue. --Vahid From: Jason Gustafson To: dev@kafka.apache.org Cc: Kafka User

Re: [DISCUSS] KIP-82 - Add Record Headers

2016-10-07 Thread Joel Koshy
Hi Jay, Couple of comments inline: One of things that has helped keep Kafka simple is not adding in new > abstractions and concepts except when the proposal is really elegant and > makes things simpler. > I don't quite see how this impacts simplicity because (per your taxonomy) the scope is "com

Build failed in Jenkins: kafka-trunk-jdk8 #953

2016-10-07 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-4262; Increase data volume in replication test -- [...truncated 3832 lines...] kafka.coordinator.GroupMetadataManagerTest > testExpireGroup STARTED kafka.coordinator

[GitHub] kafka pull request #1890: MINOR: Use `hiResClockMs` in `testRequestExpiry` t...

2016-10-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1890 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-264) Change the consumer side load balancing and distributed co-ordination to use a consumer co-ordinator

2016-10-07 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-264: -- Fix Version/s: (was: 0.10.1.0) > Change the consumer side load balancing and distributed co-o

Re: [VOTE] 0.10.1.0 RC0

2016-10-07 Thread Jason Gustafson
> > I suggest not having a "Fix version" set for issues that don't fix anything > (it's not part of any release really). Yeah, good call. On Fri, Oct 7, 2016 at 8:59 AM, Ismael Juma wrote: > On Fri, Oct 7, 2016 at 4:56 PM, Jason Gustafson > wrote: > > > @Vahid Thanks, do you want to submit a

Re: [VOTE] 0.10.1.0 RC0

2016-10-07 Thread Ismael Juma
On Fri, Oct 7, 2016 at 4:56 PM, Jason Gustafson wrote: > @Vahid Thanks, do you want to submit a patch for the quickstart fixes? We > won't need another RC if it's just doc changes. The exception is a little > more troubling. Perhaps open a JIRA and we can begin investigation? It's > especially st

  1   2   >