The last batch of data is never qualified for processing by the punctuate method. - Kafka Streams

2017-08-21 Thread Harish Subramaniam
Hi Team I am seeing inconsistent behaviour in the punctuate method , let me explain the issue Use Case : a) I am getting data from a topic X . b) Processor receives the data as on when the data is published by the KafkaProducer (each an every data is received on real time , no problem with

[jira] [Created] (KAFKA-5760) The kafka Consumer can not poll the message by multi-thread

2017-08-21 Thread Julius (JIRA)
Julius created KAFKA-5760: - Summary: The kafka Consumer can not poll the message by multi-thread Key: KAFKA-5760 URL: https://issues.apache.org/jira/browse/KAFKA-5760 Project: Kafka Issue Type: Bug

[GitHub] kafka pull request #3709: KAFKA-5759; Allow user to specify relative path as...

2017-08-21 Thread lindong28
GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/3709 KAFKA-5759; Allow user to specify relative path as log directory You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindong28/kafka KAFKA-5759

[jira] [Created] (KAFKA-5759) Allow user to specify relative path as log directory

2017-08-21 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5759: --- Summary: Allow user to specify relative path as log directory Key: KAFKA-5759 URL: https://issues.apache.org/jira/browse/KAFKA-5759 Project: Kafka Issue Type: Bug

Jenkins build is back to normal : kafka-trunk-jdk7 #2659

2017-08-21 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk7 #2658

2017-08-21 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5747; Producer snapshot loading should cover schema errors [ismael] KAFKA-5743; Ducktape services should use subdirs of /mnt -- [...truncated

[GitHub] kafka pull request #3708: [WIP] KAFKA-4764: Wrap SASL tokens in Kafka header...

2017-08-21 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/3708 [WIP] KAFKA-4764: Wrap SASL tokens in Kafka headers to improve diagnostics SASL handshake protocol changes from KIP-152. You can merge this pull request into a Git repository by running:

Improvement for Kafka Serializer API

2017-08-21 Thread Bhaskar Gollapudi
Hi , I wanted to put forward an idea that occurred to me while using Kafka Producer api. Consider the Serializer : Its main method is : byte[] serialize(String topic, T data); Producer applications create a implementation that takes in an instance ( of T ) and convert that to a byte[]. This

[GitHub] kafka pull request #3660: KAFKA-5727: Archetype project for Streams quicksta...

2017-08-21 Thread guozhangwang
Github user guozhangwang closed the pull request at: https://github.com/apache/kafka/pull/3660 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

Jenkins build is back to normal : kafka-trunk-jdk8 #1928

2017-08-21 Thread Apache Jenkins Server
See

Re: Jenkins updates: Java 9 and less noise in PR builds

2017-08-21 Thread Gwen Shapira
Thank you for these improvements! Especially the second is much appreciated. On Sun, Aug 20, 2017 at 1:35 AM Ismael Juma wrote: > Hi all, > > A couple of Jenkins updates: > > 1. We now have Java 9 builds for PRs and trunk. The Java 9 build doesn't > currently run the tests or

CredentialCache might leak through Log

2017-08-21 Thread Rodrigo Andrade
Hi all, I think Kafka should avoid printing SaslServerAuthenticator.credentialCache information through Log. I noticed that it might happen at lines 162 and 181 in SaslServerAuthentication. More specifically, through these lines: *LOG.debug("Creating SaslServer for {} with mechanism {}",

Re: [DISCUSS] KIP-190 Asynchronous Java Kafka Producer

2017-08-21 Thread Apurva Mehta
Hi Pavel, I believe that you have been added as a contributor on the Wiki. You can move your KIP to the correct space now. Note that you will need to reassign the KIP number since 190 is already taken. Thanks, Apurva On Mon, Aug 21, 2017 at 10:52 AM, Apurva Mehta wrote: >

Build error using intellij.

2017-08-21 Thread satyajit vegesna
Hi, I am trying to build kafka from source code, but i get below error when i try to build the project.(Have use gradle .idea command) and when i try to click on the import statements, they end up opening in test folder of client package and not main package. Any help would be appreciated.

Jenkins build is back to normal : kafka-0.11.0-jdk7 #278

2017-08-21 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #3707: MINOR: Verify startup of zookeeper service in syst...

2017-08-21 Thread kkonstantine
GitHub user kkonstantine opened a pull request: https://github.com/apache/kafka/pull/3707 MINOR: Verify startup of zookeeper service in system tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/kkonstantine/kafka

Build failed in Jenkins: kafka-trunk-jdk8 #1927

2017-08-21 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5747; Producer snapshot loading should cover schema errors [ismael] KAFKA-5743; Ducktape services should use subdirs of /mnt -- [...truncated

[GitHub] kafka pull request #3695: MINOR: Typographical error corrected in the Stream...

2017-08-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3695 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-190 Asynchronous Java Kafka Producer

2017-08-21 Thread Apurva Mehta
Hi Pavel, Thanks for the KIP. You need to be added to the contributors list before you can modify the Kafka wiki space. One of the committers will add you and let you know when it has happened. After that, you can create the KIP in the right space. Thanks, Apurva On Fri, Aug 18, 2017 at 12:55

[jira] [Resolved] (KAFKA-5753) ShellTest.testRunProgramWithErrorReturn fails on macOS

2017-08-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5753. Resolution: Fixed > ShellTest.testRunProgramWithErrorReturn fails on macOS >

Build failed in Jenkins: kafka-trunk-jdk7 #2657

2017-08-21 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5753; ShellTest.testRunProgramWithErrorReturn fails on macOS -- [...truncated 919.67 KB...] kafka.server.ControlledShutdownLeaderSelectorTest

Build failed in Jenkins: kafka-trunk-jdk8 #1926

2017-08-21 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5753; ShellTest.testRunProgramWithErrorReturn fails on macOS -- [...truncated 925.20 KB...] kafka.integration.AutoOffsetResetTest >

[GitHub] kafka pull request #3680: KAFKA-5743. Ducktape services should use subdirs o...

2017-08-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3680 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3688: KAFKA-5747: Producer snapshot loading should cover...

2017-08-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3688 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-5747) Broker crashes on startup when trying to parse empty snapshot files

2017-08-21 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-5747. Resolution: Fixed Issue resolved by pull request 3688

[jira] [Created] (KAFKA-5758) Reassigning a topic's partitions can adversely impact other topics

2017-08-21 Thread David van Geest (JIRA)
David van Geest created KAFKA-5758: -- Summary: Reassigning a topic's partitions can adversely impact other topics Key: KAFKA-5758 URL: https://issues.apache.org/jira/browse/KAFKA-5758 Project: Kafka

[GitHub] kafka pull request #3706: KAFKA-5753: ShellTest.testRunProgramWithErrorRetur...

2017-08-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3706 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3706: KAFKA-5753: ShellTest.testRunProgramWithErrorRetur...

2017-08-21 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3706 KAFKA-5753: ShellTest.testRunProgramWithErrorReturn fails on macOS You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka fix-shell-test-mac

[jira] [Resolved] (KAFKA-5744) ShellTest: add tests for attempting to run nonexistent program, error return

2017-08-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5744. Resolution: Fixed > ShellTest: add tests for attempting to run nonexistent program, error return >

[jira] [Reopened] (KAFKA-5753) ShellTest.testRunProgramWithErrorReturn fails locally

2017-08-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reopened KAFKA-5753: Assignee: Ismael Juma > ShellTest.testRunProgramWithErrorReturn fails locally >

[jira] [Created] (KAFKA-5757) Scheduled or Delayed connector start

2017-08-21 Thread Dhananjay Patkar (JIRA)
Dhananjay Patkar created KAFKA-5757: --- Summary: Scheduled or Delayed connector start Key: KAFKA-5757 URL: https://issues.apache.org/jira/browse/KAFKA-5757 Project: Kafka Issue Type:

[DISCUSS] KIP-190: Handle client-ids consistently between clients and brokers

2017-08-21 Thread Mickael Maison
Hi all, I have created a KIP to cleanup the way client-ids are handled by brokers and clients. Currently the Java clients have some restrictions on the client-ids that are not enforced by the brokers. Using 3rd party clients, client-ids containing any characters can be used causing some strange

[GitHub] kafka pull request #3705: [WIP] KAFKA-5746: Add new metrics to support healt...

2017-08-21 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/3705 [WIP] KAFKA-5746: Add new metrics to support health checks This is currently built on top of PR #3673 You can merge this pull request into a Git repository by running: $ git pull

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-08-21 Thread Rajini Sivaram
Hi Jun, Thank you for the review. 1. Each token response will indicate success/failure. At the moment, the broker simply closes the connection in the case of failure. With this KIP, an empty token with an error_code indicating authentication failure will be sent by the broker before closing the

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-08-21 Thread Rajini Sivaram
Ismael, Thank you for the review. I have updated the motivation section. On Fri, Aug 18, 2017 at 1:59 PM, Ismael Juma wrote: > Thanks Rajini. The changes look good. We have to update the motivation to > take into account the improvements in 0.11: > > "With the current Kafka

Re: [DISCUSS] KIP-184 Rename LogCleaner and related classes to LogCompactor

2017-08-21 Thread Pranav Maniar
Hi Jason, Haven't heard from other on this KIP. Should I close it ? ~Pranav On Thu, Aug 10, 2017 at 12:04 AM, Jason Gustafson wrote: > Hey Pranav, > > Let's see what others think before closing the KIP. If there are strong > reasons for the renaming, I would reconsider. >

[GitHub] kafka pull request #3704: KAFKA-5748 Fix console producer to set timestamp a...

2017-08-21 Thread rancp
GitHub user rancp opened a pull request: https://github.com/apache/kafka/pull/3704 KAFKA-5748 Fix console producer to set timestamp and partition You can merge this pull request into a Git repository by running: $ git pull https://github.com/rancp/kafka cproducer