[GitHub] kafka pull request: update the command to run a particular test me...

2015-10-16 Thread lindong28
GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/326 update the command to run a particular test method in readme You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindong28/kafka minor-readme Alte

Build failed in Jenkins: kafka-trunk-jdk8 #36

2015-10-16 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2515: Handle oversized messages properly in new consumer [wangguoz] KAFKA-2397: add leave group request to force coordinator trigger [wangguoz] KAFKA-2665: Add images to code github --

Build failed in Jenkins: kafka-trunk-jdk7 #696

2015-10-16 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2397: add leave group request to force coordinator trigger [wangguoz] KAFKA-2665: Add images to code github -- [...truncated 322 lines...] :kafka-trunk-jdk7:clients

Re: [DISCUSS] KIP-37 - Add namespaces in Kafka

2015-10-16 Thread Ashish Singh
On Thu, Oct 15, 2015 at 1:30 PM, Jiangjie Qin wrote: > Hey Jay, > > If we allow consumer to subscribe to /*/my-event, does that mean we allow > consumer to consume cross namespaces? That is the idea. If a user has permissions then yes, he should be able to consume from as many namespaces as he w

[jira] [Created] (KAFKA-2668) Add a metric that records the total number of metrics

2015-10-16 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-2668: - Summary: Add a metric that records the total number of metrics Key: KAFKA-2668 URL: https://issues.apache.org/jira/browse/KAFKA-2668 Project: Kafka Issue Type: Imp

[jira] [Resolved] (KAFKA-2665) Docs: Images that are part of the documentation are not part of the code github

2015-10-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2665. -- Resolution: Fixed Fix Version/s: 0.9.0.0 Issue resolved by pull request 325 [https://gith

[jira] [Commented] (KAFKA-2665) Docs: Images that are part of the documentation are not part of the code github

2015-10-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961603#comment-14961603 ] ASF GitHub Bot commented on KAFKA-2665: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2665: Docs: Images that are part of the ...

2015-10-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/325 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Updated] (KAFKA-2665) Docs: Images that are part of the documentation are not part of the code github

2015-10-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2665: - Assignee: Gwen Shapira > Docs: Images that are part of the documentation are not part of the code

[jira] [Updated] (KAFKA-2397) leave group request

2015-10-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2397: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[jira] [Commented] (KAFKA-2664) Adding a new metric with several pre-existing metrics is very expensive

2015-10-16 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961595#comment-14961595 ] Joel Koshy commented on KAFKA-2664: --- [~gwenshap] in general yes it could, but if we did

[jira] [Commented] (KAFKA-2397) leave group request

2015-10-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961597#comment-14961597 ] ASF GitHub Bot commented on KAFKA-2397: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2397: leave group request

2015-10-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/103 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2515) handle oversized messages properly in new consumer

2015-10-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961587#comment-14961587 ] ASF GitHub Bot commented on KAFKA-2515: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-2515) handle oversized messages properly in new consumer

2015-10-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2515. -- Resolution: Fixed Issue resolved by pull request 318 [https://github.com/apache/kafka/pull/318]

[GitHub] kafka pull request: KAFKA-2515: Handle oversized messages properly...

2015-10-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/318 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Build failed in Jenkins: kafka-trunk-jdk8 #35

2015-10-16 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-2484: Add schema projection utilities -- [...truncated 2800 lines...] kafka.log.LogConfigTest > testKafkaConfigToProps PASSED kafka.log.LogConfigTest > testFromPropsI

[jira] [Created] (KAFKA-2667) Copycat KafkaBasedLogTest.testSendAndReadToEnd transient failure

2015-10-16 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-2667: -- Summary: Copycat KafkaBasedLogTest.testSendAndReadToEnd transient failure Key: KAFKA-2667 URL: https://issues.apache.org/jira/browse/KAFKA-2667 Project: Kafka

[jira] [Commented] (KAFKA-2665) Docs: Images that are part of the documentation are not part of the code github

2015-10-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961534#comment-14961534 ] ASF GitHub Bot commented on KAFKA-2665: --- GitHub user gwenshap opened a pull request:

[GitHub] kafka pull request: KAFKA-2665: Docs: Images that are part of the ...

2015-10-16 Thread gwenshap
GitHub user gwenshap opened a pull request: https://github.com/apache/kafka/pull/325 KAFKA-2665: Docs: Images that are part of the documentation are not p… …art of the code github You can merge this pull request into a Git repository by running: $ git pull https://github.co

Build failed in Jenkins: kafka-trunk-jdk8 #34

2015-10-16 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2594: Add InMemoryLRUCacheStore as a preliminary method for -- [...truncated 6255 lines...] org.apache.kafka.copycat.file.FileStreamSourceConnectorTest > testSource

Re: [DISCUSS] KIP-36 - Rack aware replica assignment

2015-10-16 Thread Allen Wang
KIP is updated include rack as an optional property for broker. Please take a look and let me know if more details are needed. For the case where some brokers have rack and some do not, the current KIP uses the fail-fast behavior. If there are concerns, we can further discuss this in the email thr

[jira] [Commented] (KAFKA-2484) Add schema projection utilities

2015-10-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961476#comment-14961476 ] ASF GitHub Bot commented on KAFKA-2484: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-2484) Add schema projection utilities

2015-10-16 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2484: Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 30

[GitHub] kafka pull request: KAFKA-2484: Add schema projection utilities

2015-10-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/307 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Updated] (KAFKA-2484) Add schema projection utilities

2015-10-16 Thread Liquan Pei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liquan Pei updated KAFKA-2484: -- Status: Patch Available (was: In Progress) > Add schema projection utilities >

[jira] [Updated] (KAFKA-2484) Add schema projection utilities

2015-10-16 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2484: - Reviewer: Gwen Shapira > Add schema projection utilities > ---

[jira] [Created] (KAFKA-2665) Docs: Images that are part of the documentation are not part of the code github

2015-10-16 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-2665: --- Summary: Docs: Images that are part of the documentation are not part of the code github Key: KAFKA-2665 URL: https://issues.apache.org/jira/browse/KAFKA-2665 Project:

[jira] [Created] (KAFKA-2666) Docs: Automatically generate documentation from config classes

2015-10-16 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-2666: --- Summary: Docs: Automatically generate documentation from config classes Key: KAFKA-2666 URL: https://issues.apache.org/jira/browse/KAFKA-2666 Project: Kafka I

[jira] [Resolved] (KAFKA-2412) Documentation bug: Add information for key.serializer and value.serializer to New Producer Config sections

2015-10-16 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-2412. - Resolution: Fixed In 0.9.0.0 we plan to auto-generate the configuration docs from code, so all th

[jira] [Commented] (KAFKA-2640) Add tests for ZK authentication

2015-10-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961427#comment-14961427 ] ASF GitHub Bot commented on KAFKA-2640: --- GitHub user fpj opened a pull request:

[GitHub] kafka pull request: KAFKA-2640: Add tests for ZK authentication

2015-10-16 Thread fpj
GitHub user fpj opened a pull request: https://github.com/apache/kafka/pull/324 KAFKA-2640: Add tests for ZK authentication I've added a couple of initial tests to verify the functionality. I've tested that the JAAS config file loads properly and SASL with DIGEST-MD5 works with Zoo

[jira] [Updated] (KAFKA-2594) Add a key-value store that is a fixed-capacity in-memory LRU cache

2015-10-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2594: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[jira] [Commented] (KAFKA-2594) Add a key-value store that is a fixed-capacity in-memory LRU cache

2015-10-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961401#comment-14961401 ] ASF GitHub Bot commented on KAFKA-2594: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2594 Added InMemoryLRUCacheStore

2015-10-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/256 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2664) Adding a new metric with several pre-existing metrics is very expensive

2015-10-16 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961345#comment-14961345 ] Gwen Shapira commented on KAFKA-2664: - I'm not certain this is just quotas. We added t

[jira] [Commented] (KAFKA-2456) Disable SSLv3 for ssl.enabledprotocols config on client & broker side

2015-10-16 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961321#comment-14961321 ] Ismael Juma commented on KAFKA-2456: That's right, Ben. My suggestion is to use the JD

[jira] [Commented] (KAFKA-2456) Disable SSLv3 for ssl.enabledprotocols config on client & broker side

2015-10-16 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961293#comment-14961293 ] Sriharsha Chintalapani commented on KAFKA-2456: --- [~benstopford] please go fo

[jira] [Created] (KAFKA-2664) Adding a new metric with several pre-existing metrics is very expensive

2015-10-16 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-2664: - Summary: Adding a new metric with several pre-existing metrics is very expensive Key: KAFKA-2664 URL: https://issues.apache.org/jira/browse/KAFKA-2664 Project: Kafka

[jira] [Created] (KAFKA-2663) Add quota-delay time to request processing time break-up

2015-10-16 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-2663: - Summary: Add quota-delay time to request processing time break-up Key: KAFKA-2663 URL: https://issues.apache.org/jira/browse/KAFKA-2663 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-2456) Disable SSLv3 for ssl.enabledprotocols config on client & broker side

2015-10-16 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961208#comment-14961208 ] Ben Stopford commented on KAFKA-2456: - [~ijuma][~harsha_ch] It looks like this is actu

LogStartOffset MBean

2015-10-16 Thread Sonal Jain
Hi, I have a technical question regarding LogStartOffset MBean. Please let me know if this is not a right forum to ask this question. Question# I want to calculate lag in the consumer and want to create a lag metric. I have defined jmx MBeans. I have 3 consumers running with 3 partitions each. Lo

[jira] [Commented] (KAFKA-2515) handle oversized messages properly in new consumer

2015-10-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961064#comment-14961064 ] Guozhang Wang commented on KAFKA-2515: -- Yup, in the latest patch we will throw Record

Build failed in Jenkins: kafka-trunk-jdk8 #33

2015-10-16 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2120: cleaning follow-up [junrao] KAFKA-2419 - Fix to prevent background thread from getting created when -- [...truncated 362 lines...] :kafka-trunk-jdk8:core:compi

[jira] [Commented] (KAFKA-2515) handle oversized messages properly in new consumer

2015-10-16 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960997#comment-14960997 ] Onur Karaman commented on KAFKA-2515: - +1 on Jason's comment. With just the log messag

[jira] [Commented] (KAFKA-2419) Allow certain Sensors to be garbage collected after inactivity

2015-10-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960994#comment-14960994 ] ASF GitHub Bot commented on KAFKA-2419: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-2419) Allow certain Sensors to be garbage collected after inactivity

2015-10-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-2419. Resolution: Fixed Issue resolved by pull request 323 [https://github.com/apache/kafka/pull/323] > Allow cer

[jira] [Updated] (KAFKA-2515) handle oversized messages properly in new consumer

2015-10-16 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2515: Assignee: Guozhang Wang (was: Ben Stopford) > handle oversized messages properly in new consumer >

[GitHub] kafka pull request: KAFKA-2419 - Fix to prevent background thread ...

2015-10-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/323 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Assigned] (KAFKA-2515) handle oversized messages properly in new consumer

2015-10-16 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-2515: --- Assignee: Ben Stopford (was: Jason Gustafson) > handle oversized messages properly in new co

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

2015-10-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960985#comment-14960985 ] ASF GitHub Bot commented on KAFKA-2120: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2120

2015-10-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/320 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Created] (KAFKA-2662) Make ConsumerIterator thread-safe for multiple threads in different Kafka groups

2015-10-16 Thread Andrew Pennebaker (JIRA)
Andrew Pennebaker created KAFKA-2662: Summary: Make ConsumerIterator thread-safe for multiple threads in different Kafka groups Key: KAFKA-2662 URL: https://issues.apache.org/jira/browse/KAFKA-2662

[jira] [Commented] (KAFKA-2017) Persist Coordinator State for Coordinator Failover

2015-10-16 Thread Todd Palino (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960809#comment-14960809 ] Todd Palino commented on KAFKA-2017: Just to throw in my 2 cents here, I don't think t

Kafka synchronous mode performance issue

2015-10-16 Thread Dinesh J
Hi All, We are using Kafka-Net(C#) for our kafka messaging system, we tested Producer to produce message to Kafka with Synchronous and Asynchronous mode. But In Asynchronous mode it performs well than Synchronous. Synchronous mode takes 2 minutes to produce 1000 message where as Asynchronous mode