[jira] [Commented] (KAFKA-3744) Message format needs to identify serializer

2016-05-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303666#comment-15303666 ] Ewen Cheslack-Postava commented on KAFKA-3744: -- Just to second [~ijuma]'s com

Re: KAFKA-3722 : Discussion about custom PrincipalBuilder and Authorizer configs

2016-05-27 Thread Harsha
Mayuresh & Ismael, Agree on not breaking interfaces on public API. +1 on option 2. Thanks, Harsha On Mon, May 23, 2016, at 10:30 AM, Mayuresh Gharat wrote: > Hi Harsha and Ismael, > > Option 2 sounds like a good idea if we want to make this quick fix

Build failed in Jenkins: kafka-trunk-jdk8 #655

2016-05-27 Thread Apache Jenkins Server
See Changes: [me] MINOR: Delete unused code in FileStreamSourceTask -- [...truncated 3936 lines...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[5] PASSED kafka.log.BrokerCompres

[jira] [Created] (KAFKA-3763) Remove deprecated APIs

2016-05-27 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-3763: -- Summary: Remove deprecated APIs Key: KAFKA-3763 URL: https://issues.apache.org/jira/browse/KAFKA-3763 Project: Kafka Issue Type: Task Reporter: Ismae

Re: [HEADS-UP] Modification to KIP Template

2016-05-27 Thread Ismael Juma
Hi Gwen, Thanks for adding the "Test Plans" section. I think it may be worth adding a note about performance testing plans too (whenever relevant). By the way, even though the following page has the new section, if I use `Create -> KIP-Template`, the new section doesn't appear. Do you know why? h

Re: Kafka server contains messages but consumer cannot receive any(Producer used compression.type = snappy)

2016-05-27 Thread Shaolu Xu
Hi Jason, I'm so sorry to reply your email later. Your solution solved my issue. When I use "earliest" for auto.offset.reset, the consumer can receiver messages. Thanks a lot, Nicole On Thu, May 26, 2016 at 11:21 AM, Jason Gustafson wrote: > Hi Nicole, > > It would help to see some log files.

[GitHub] kafka pull request: KAFKA-3749, fix "BOOSTRAP_SERVERS_DOC" typo

2016-05-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1420 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3749) "BOOSTRAP_SERVERS_DOC" typo in CommonClientConfigs

2016-05-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303814#comment-15303814 ] ASF GitHub Bot commented on KAFKA-3749: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-3749) "BOOSTRAP_SERVERS_DOC" typo in CommonClientConfigs

2016-05-27 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3749. Resolution: Fixed Reviewer: Ismael Juma Fix Version/s: 0.10.1.0 > "BOOSTRAP_SERVERS_

[jira] [Updated] (KAFKA-3749) "BOOSTRAP_SERVERS_DOC" typo in CommonClientConfigs

2016-05-27 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3749: --- Assignee: Manu Zhang > "BOOSTRAP_SERVERS_DOC" typo in CommonClientConfigs > --

Build failed in Jenkins: kafka-trunk-jdk7 #1319

2016-05-27 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3749; fix "BOOSTRAP_SERVERS_DOC" typo -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (docker Ubuntu ubuntu yah

[jira] [Assigned] (KAFKA-3561) Auto create through topic for KStream aggregation and join

2016-05-27 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reassigned KAFKA-3561: - Assignee: Damian Guy > Auto create through topic for KStream aggregation and join > -

[jira] [Commented] (KAFKA-3561) Auto create through topic for KStream aggregation and join

2016-05-27 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303877#comment-15303877 ] Damian Guy commented on KAFKA-3561: --- Guozhang - i'd like to do this if it is ok with you

Build failed in Jenkins: kafka-trunk-jdk8 #656

2016-05-27 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-3749; fix "BOOSTRAP_SERVERS_DOC" typo -- [...truncated 63 lines...]

[GitHub] kafka pull request: MINOR: Kafka And ZooKeeper Stop Scripts doesn'...

2016-05-27 Thread Kamal15
GitHub user Kamal15 opened a pull request: https://github.com/apache/kafka/pull/1438 MINOR: Kafka And ZooKeeper Stop Scripts doesn't return PID In Centos 6.5, 'ps -ax | grep java' command doesn't returns the full process name. So, the command doesn't returns the PID even Kafka a

Re: [VOTE] KIP-58 - Make Log Compaction Point Configurable

2016-05-27 Thread Jun Rao
Thanks for the proposal. +1 Jun On Tue, May 24, 2016 at 1:37 PM, Eric Wasserman wrote: > Hi, > > I would like to begin voting on KIP-58 - Make Log Compaction Point > Configurable > > KIP-58 is here: < > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-58+-+Make+Log+Compaction+Point+Conf

[jira] [Commented] (KAFKA-3637) Add method that checks if streams are initialised

2016-05-27 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304171#comment-15304171 ] Eno Thereska commented on KAFKA-3637: - Hi [~tszym]. I just added a method that might h

[jira] [Resolved] (KAFKA-3637) Add method that checks if streams are initialised

2016-05-27 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska resolved KAFKA-3637. - Resolution: Won't Fix > Add method that checks if streams are initialised > --

[jira] [Commented] (KAFKA-3637) Add method that checks if streams are initialised

2016-05-27 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304224#comment-15304224 ] Eno Thereska commented on KAFKA-3637: - It turns out it might not make sense to have an

[GitHub] kafka pull request: KAFKA-3678: Removed sleep

2016-05-27 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/1439 KAFKA-3678: Removed sleep You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka KAFKA-3678-timeouts1 Alternatively you can revi

[jira] [Commented] (KAFKA-3678) Fix stream integration test timeouts

2016-05-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304237#comment-15304237 ] ASF GitHub Bot commented on KAFKA-3678: --- GitHub user enothereska opened a pull reque

[jira] [Work started] (KAFKA-3678) Fix stream integration test timeouts

2016-05-27 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3678 started by Eno Thereska. --- > Fix stream integration test timeouts > > >

[GitHub] kafka pull request: MINOR: Fix a couple of typos

2016-05-27 Thread vahidhashemian
GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/1440 MINOR: Fix a couple of typos You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian/kafka typo06/fix_typos_in_code_comments Alt

Re: [DISCUSS] KIP-55: Secure quotas for authenticated users

2016-05-27 Thread Jun Rao
Rajini, Thanks for the updated KIP. Looks good overall. Just a few minor comments. 10. For quota related metric names, currently, they already have a tag "client-d". It seems that we can just replace it with a similar tag "user" if quota.type is user. The sensor names only have the client-id valu

Re: KAFKA-3722 : Discussion about custom PrincipalBuilder and Authorizer configs

2016-05-27 Thread Mayuresh Gharat
Cool. I will upload a patch for this. Thanks, Mayuresh On Fri, May 27, 2016 at 12:35 AM, Harsha wrote: > Mayuresh & Ismael, >Agree on not breaking interfaces on public API. >+1 on option 2. > Thanks, > Harsha > > On Mon, May 23, 2016, at 10:30 AM

[jira] [Commented] (KAFKA-3561) Auto create through topic for KStream aggregation and join

2016-05-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304347#comment-15304347 ] Guozhang Wang commented on KAFKA-3561: -- Hi [~damianguy] a couple thoughts: 1. Topics

[jira] [Assigned] (KAFKA-3762) Log.loadSegments() should log the message in exception

2016-05-27 Thread Ishita Mandhan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishita Mandhan reassigned KAFKA-3762: - Assignee: Ishita Mandhan > Log.loadSegments() should log the message in exception > -

Re: [DISCUSS] KIP-55: Secure quotas for authenticated users

2016-05-27 Thread Rajini Sivaram
Jun, Thank you for the review and the suggestions. I have updated the KIP with the changes you suggested. On Fri, May 27, 2016 at 5:24 PM, Jun Rao wrote: > Rajini, > > Thanks for the updated KIP. Looks good overall. Just a few minor comments. > > 10. For quota related metric names, currently,

Re: [VOTE] KIP-58 - Make Log Compaction Point Configurable

2016-05-27 Thread Gwen Shapira
Hey, its been over 3 days since the vote started and we clearly have over 3 +1s. Eric, Feel free to close the vote and we can move to code reviews :) Gwen On Fri, May 27, 2016 at 8:08 AM, Jun Rao wrote: > Thanks for the proposal. +1 > > Jun > > On Tue, May 24, 2016 at 1:37 PM, Eric Wasserman

[jira] [Created] (KAFKA-3764) Error processing append operation on partition

2016-05-27 Thread Martin Nowak (JIRA)
Martin Nowak created KAFKA-3764: --- Summary: Error processing append operation on partition Key: KAFKA-3764 URL: https://issues.apache.org/jira/browse/KAFKA-3764 Project: Kafka Issue Type: Bug

[GitHub] kafka pull request: MINOR: Fix tracing in KafkaApis.handle()

2016-05-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1435 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk7 #1320

2016-05-27 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Fix tracing in KafkaApis.handle() -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (docker Ubuntu ubuntu yahoo-

[jira] [Commented] (KAFKA-3764) Error processing append operation on partition

2016-05-27 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304742#comment-15304742 ] Ismael Juma commented on KAFKA-3764: Is there any chance you could test with a differe

[GitHub] kafka pull request: MINOR: Fix a couple of typos

2016-05-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1440 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #657

2016-05-27 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Fix tracing in KafkaApis.handle() [ismael] MINOR: Fix a couple of scaladoc typos -- [...truncated 63 lines...]

Build failed in Jenkins: kafka-0.10.0-jdk7 #110

2016-05-27 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Fix tracing in KafkaApis.handle() -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H10 (docker Ubuntu ubuntu yahoo-

[GitHub] kafka pull request: MINOR: Remove synchronized as the tasks are ex...

2016-05-27 Thread Ishiihara
GitHub user Ishiihara opened a pull request: https://github.com/apache/kafka/pull/1441 MINOR: Remove synchronized as the tasks are executed sequentially You can merge this pull request into a Git repository by running: $ git pull https://github.com/Ishiihara/kafka remove-synch

Build failed in Jenkins: kafka-trunk-jdk7 #1321

2016-05-27 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Fix a couple of scaladoc typos -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (docker Ubuntu ubuntu yahoo-not

[GitHub] kafka pull request: KAFKA-3682 ArrayIndexOutOfBoundsException thro...

2016-05-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1352 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-3682) ArrayIndexOutOfBoundsException thrown by SkimpyOffsetMap.get() when full

2016-05-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-3682. Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1352 [https://github.com/apa

[jira] [Commented] (KAFKA-3682) ArrayIndexOutOfBoundsException thrown by SkimpyOffsetMap.get() when full

2016-05-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304932#comment-15304932 ] ASF GitHub Bot commented on KAFKA-3682: --- Github user asfgit closed the pull request

Build failed in Jenkins: kafka-trunk-jdk8 #658

2016-05-27 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-3682; ArrayIndexOutOfBoundsException thrown by -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-us1 (Ubuntu ub

[jira] [Commented] (KAFKA-3763) Remove deprecated APIs

2016-05-27 Thread Amey (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304973#comment-15304973 ] Amey commented on KAFKA-3763: - [~ijuma] I can work on this Jira, would you mind If I take this

[jira] [Commented] (KAFKA-3763) Remove deprecated APIs

2016-05-27 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304974#comment-15304974 ] Ismael Juma commented on KAFKA-3763: Sure, but note that this is planned for 0.11.0 an

Build failed in Jenkins: kafka-trunk-jdk7 #1322

2016-05-27 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-3682; ArrayIndexOutOfBoundsException thrown by -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (docker Ubuntu u

Kafka/Samza meetup at LinkedIn, June 15, 6pm

2016-05-27 Thread Joel Koshy
[bcc: us...@kafka.apache.org, dev@kafka.apache.org] Hi everyone, We would like to invite you to our first Stream Processing Meetup at LinkedIn on June 15 at 6pm. Please RSVP here: http://www.meetup.com/Stream-Processing-Meetup-LinkedIn/events/231454378 Going forward (at LinkedIn) we will host me

[jira] [Created] (KAFKA-3765) Code style issues in Kafka

2016-05-27 Thread Rekha Joshi (JIRA)
Rekha Joshi created KAFKA-3765: -- Summary: Code style issues in Kafka Key: KAFKA-3765 URL: https://issues.apache.org/jira/browse/KAFKA-3765 Project: Kafka Issue Type: Improvement Compon

[GitHub] kafka pull request: [KAFKA-3765] Minor Code style corrections

2016-05-27 Thread rekhajoshm
GitHub user rekhajoshm opened a pull request: https://github.com/apache/kafka/pull/1442 [KAFKA-3765] Minor Code style corrections [KAFKA-3765] Minor Code style corrections: Removed explicit returns, not needed parentheses, corrected variables, removed unused imports You can mer

[jira] [Commented] (KAFKA-3765) Code style issues in Kafka

2016-05-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305022#comment-15305022 ] ASF GitHub Bot commented on KAFKA-3765: --- GitHub user rekhajoshm opened a pull reques

[jira] [Created] (KAFKA-3766) Unhandled "not enough replicas" errors in SyncGroup

2016-05-27 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3766: -- Summary: Unhandled "not enough replicas" errors in SyncGroup Key: KAFKA-3766 URL: https://issues.apache.org/jira/browse/KAFKA-3766 Project: Kafka Issue T

[GitHub] kafka pull request: KAFKA-3678: Removed sleep

2016-05-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1439 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-3678) Fix stream integration test timeouts

2016-05-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-3678. -- Resolution: Fixed Issue resolved by pull request 1439 [https://github.com/apache/kafka/pull/1439

[jira] [Commented] (KAFKA-3678) Fix stream integration test timeouts

2016-05-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305091#comment-15305091 ] ASF GitHub Bot commented on KAFKA-3678: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-3753) Metrics for StateStores

2016-05-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3753: - Labels: api (was: ) > Metrics for StateStores > --- > > Key:

[jira] [Commented] (KAFKA-3753) Metrics for StateStores

2016-05-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305100#comment-15305100 ] Guozhang Wang commented on KAFKA-3753: -- This is a good suggestion, and we can either

[jira] [Commented] (KAFKA-3758) KStream job fails to recover after Kafka broker stopped

2016-05-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305108#comment-15305108 ] Guozhang Wang commented on KAFKA-3758: -- Thanks for reporting, and we are aware of thi

Build failed in Jenkins: kafka-trunk-jdk8 #659

2016-05-27 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3678: Removed sleep from streams integration tests -- [...truncated 63 lines...]

Build failed in Jenkins: kafka-trunk-jdk7 #1323

2016-05-27 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3678: Removed sleep from streams integration tests -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (docker Ub