Jenkins build is back to normal : kafka-trunk-jdk7 #774

2015-11-06 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #112

2015-11-06 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-2666: Docs: Automatically generate documentation from config -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu3

New release branch - 0.9.0

2015-11-06 Thread Gwen Shapira
Hi Kafka Devs, I've just created new release branch for upcoming release 0.9.0, in preparation for cutting release candidates early next week. Patches for 0.9.0 release blockers should be committed to both trunk and 0.9.0. All other patches should be committed to trunk as usual. https://git-wip-

[jira] [Updated] (KAFKA-2666) Docs: Automatically generate documentation from config classes

2015-11-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2666: Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 38

[jira] [Commented] (KAFKA-2666) Docs: Automatically generate documentation from config classes

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994986#comment-14994986 ] ASF GitHub Bot commented on KAFKA-2666: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2666: Docs: Automatically generate docum...

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/382 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Build failed in Jenkins: kafka-trunk-jdk7 #773

2015-11-06 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-2765: Add versions to Copycat Connector and Task interfaces and [cshapi] KAFKA-2766: use new producer by default in tooling [junrao] KAFKA-2767; Upgrade ZkClient version to 0.7

[jira] [Resolved] (KAFKA-2767) Upgrade ZkClient version to 0.7

2015-11-06 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-2767. Resolution: Fixed Issue resolved by pull request 449 [https://github.com/apache/kafka/pull/449] > Upgrade Z

[jira] [Commented] (KAFKA-2767) Upgrade ZkClient version to 0.7

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994890#comment-14994890 ] ASF GitHub Bot commented on KAFKA-2767: --- Github user asfgit closed the pull request

Build failed in Jenkins: kafka-trunk-jdk8 #111

2015-11-06 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-2765: Add versions to Copycat Connector and Task interfaces and [cshapi] KAFKA-2766: use new producer by default in tooling [junrao] KAFKA-2767; Upgrade ZkClient version to 0.7

[GitHub] kafka pull request: KAFKA-2767: Upgrade ZkClient version to 0.7

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/449 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2766) Make the Java Producer as the default producer in tooling.

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994871#comment-14994871 ] ASF GitHub Bot commented on KAFKA-2766: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-2766) Make the Java Producer as the default producer in tooling.

2015-11-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-2766. - Resolution: Fixed Issue resolved by pull request 448 [https://github.com/apache/kafka/pull/448] >

[GitHub] kafka pull request: KAFKA-2766: use new producer by default in too...

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/448 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (KAFKA-2765) Connectors and tasks should have versions that can be reported when they are instantiated

2015-11-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-2765. - Resolution: Fixed Issue resolved by pull request 446 [https://github.com/apache/kafka/pull/446] >

[jira] [Commented] (KAFKA-2765) Connectors and tasks should have versions that can be reported when they are instantiated

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994863#comment-14994863 ] ASF GitHub Bot commented on KAFKA-2765: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2765: Add versions to Copycat Connector ...

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/446 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Updated] (KAFKA-2723) Standardize new consumer exceptions

2015-11-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2723: - Priority: Blocker (was: Major) > Standardize new consumer exceptions > --

[jira] [Updated] (KAFKA-2666) Docs: Automatically generate documentation from config classes

2015-11-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2666: - Fix Version/s: 0.9.0.0 > Docs: Automatically generate documentation from config classes >

[jira] [Updated] (KAFKA-2666) Docs: Automatically generate documentation from config classes

2015-11-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2666: - Priority: Blocker (was: Major) > Docs: Automatically generate documentation from config classes >

[jira] [Updated] (KAFKA-2723) Standardize new consumer exceptions

2015-11-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2723: - Fix Version/s: 0.9.0.0 > Standardize new consumer exceptions > ---

[jira] [Created] (KAFKA-2770) Race condition causes Mirror Maker to hang during shutdown (new consumer)

2015-11-06 Thread Geoff Anderson (JIRA)
Geoff Anderson created KAFKA-2770: - Summary: Race condition causes Mirror Maker to hang during shutdown (new consumer) Key: KAFKA-2770 URL: https://issues.apache.org/jira/browse/KAFKA-2770 Project: Ka

[jira] [Updated] (KAFKA-2766) Make the Java Producer as the default producer in tooling.

2015-11-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2766: - Priority: Blocker (was: Major) > Make the Java Producer as the default producer in tooling. > ---

Build failed in Jenkins: kafka-trunk-jdk7 #772

2015-11-06 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fix homophone typo in Design documentation [wangguoz] MINOR: Remove unnecessary println -- [...truncated 3149 lines...] kafka.integration.SslTopicMetadataTest > te

[jira] [Created] (KAFKA-2769) Integration tests for multi-consumer assignment including session timeouts

2015-11-06 Thread Anna Povzner (JIRA)
Anna Povzner created KAFKA-2769: --- Summary: Integration tests for multi-consumer assignment including session timeouts Key: KAFKA-2769 URL: https://issues.apache.org/jira/browse/KAFKA-2769 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #110

2015-11-06 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fix homophone typo in Design documentation [wangguoz] MINOR: Remove unnecessary println -- Started by an SCM change [EnvInject] - Loading node environment variable

Build failed in Jenkins: kafka-trunk-jdk8 #109

2015-11-06 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2764: Change use of Properties in Copycat to Maps. [wangguoz] KAFKA-2760: Clean up interface of AdminClient.describeConsumerGroup. [wangguoz] KAFKA-2734: kafka-console-consumer should allow empty topic fo

[GitHub] kafka pull request: MINOR: Remove unnecessary println

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/429 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] kafka pull request: MINOR: Fix homophone typo in Design documentat...

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/391 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Build failed in Jenkins: kafka-trunk-jdk7 #771

2015-11-06 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2764: Change use of Properties in Copycat to Maps. [wangguoz] KAFKA-2760: Clean up interface of AdminClient.describeConsumerGroup. [wangguoz] KAFKA-2734: kafka-console-consumer should allow empty topic fo

[GitHub] kafka pull request: KAFKA-2767: Upgrade ZkClient version to 0.7

2015-11-06 Thread fpj
GitHub user fpj opened a pull request: https://github.com/apache/kafka/pull/449 KAFKA-2767: Upgrade ZkClient version to 0.7 You can merge this pull request into a Git repository by running: $ git pull https://github.com/fpj/kafka KAFKA-2767 Alternatively you can review and ap

[jira] [Commented] (KAFKA-2767) Upgrade ZkClient version to 0.7

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994664#comment-14994664 ] ASF GitHub Bot commented on KAFKA-2767: --- GitHub user fpj opened a pull request:

[jira] [Resolved] (KAFKA-2736) ZkClient doesn't handle SaslAuthenticated

2015-11-06 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flavio Junqueira resolved KAFKA-2736. - Resolution: Fixed Issue closed and incorporate into ZkClient. > ZkClient doesn't handle S

[jira] [Commented] (KAFKA-2766) Make the Java Producer as the default producer in tooling.

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994635#comment-14994635 ] ASF GitHub Bot commented on KAFKA-2766: --- GitHub user guozhangwang opened a pull requ

[GitHub] kafka pull request: KAFKA-2766: use new producer by default in too...

2015-11-06 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/448 KAFKA-2766: use new producer by default in tooling Also update the API docs for new consumer. You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] kafka pull request: KAFKA-2768: New-consumer sends invalid describ...

2015-11-06 Thread SinghAsDev
GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/447 KAFKA-2768: New-consumer sends invalid describeGroupResponse while re… …stabilizing You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAs

[jira] [Commented] (KAFKA-2768) New-consumer sends invalid describeGroupResponse while restabilizing

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994599#comment-14994599 ] ASF GitHub Bot commented on KAFKA-2768: --- GitHub user SinghAsDev opened a pull reques

[jira] [Created] (KAFKA-2768) New-consumer sends invalid describeGroupResponse while restabilizing

2015-11-06 Thread Ashish K Singh (JIRA)
Ashish K Singh created KAFKA-2768: - Summary: New-consumer sends invalid describeGroupResponse while restabilizing Key: KAFKA-2768 URL: https://issues.apache.org/jira/browse/KAFKA-2768 Project: Kafka

[jira] [Commented] (KAFKA-2759) Mirror maker can leave gaps of missing messages if the process dies after a partition is reset and before the first offset commit

2015-11-06 Thread Todd Palino (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994590#comment-14994590 ] Todd Palino commented on KAFKA-2759: The thought we had internally on the situation in

[jira] [Created] (KAFKA-2767) Upgrade ZkClient version to 0.7

2015-11-06 Thread Flavio Junqueira (JIRA)
Flavio Junqueira created KAFKA-2767: --- Summary: Upgrade ZkClient version to 0.7 Key: KAFKA-2767 URL: https://issues.apache.org/jira/browse/KAFKA-2767 Project: Kafka Issue Type: Improvement

[jira] [Assigned] (KAFKA-2480) Handle non-CopycatExceptions from SinkTasks

2015-11-06 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava reassigned KAFKA-2480: Assignee: Ewen Cheslack-Postava (was: Liquan Pei) > Handle non-CopycatExce

[jira] [Commented] (KAFKA-2765) Connectors and tasks should have versions that can be reported when they are instantiated

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994514#comment-14994514 ] ASF GitHub Bot commented on KAFKA-2765: --- GitHub user ewencp opened a pull request:

[jira] [Created] (KAFKA-2766) Make the Java Producer as the default producer in tooling.

2015-11-06 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-2766: Summary: Make the Java Producer as the default producer in tooling. Key: KAFKA-2766 URL: https://issues.apache.org/jira/browse/KAFKA-2766 Project: Kafka Issu

[jira] [Commented] (KAFKA-2759) Mirror maker can leave gaps of missing messages if the process dies after a partition is reset and before the first offset commit

2015-11-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994511#comment-14994511 ] Guozhang Wang commented on KAFKA-2759: -- We were discussing about the default reset po

[GitHub] kafka pull request: KAFKA-2765: Add versions to Copycat Connector ...

2015-11-06 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/446 KAFKA-2765: Add versions to Copycat Connector and Task interfaces and log versions when instantiating connectors and tasks. You can merge this pull request into a Git repository by running: $ g

[jira] [Resolved] (KAFKA-2747) Message loss if mirror maker is killed with hard kill and then restarted

2015-11-06 Thread Geoff Anderson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geoff Anderson resolved KAFKA-2747. --- Resolution: Not A Problem > Message loss if mirror maker is killed with hard kill and then res

[jira] [Commented] (KAFKA-2747) Message loss if mirror maker is killed with hard kill and then restarted

2015-11-06 Thread Geoff Anderson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994508#comment-14994508 ] Geoff Anderson commented on KAFKA-2747: --- [~becket_qin] The group id is the same, but

[jira] [Created] (KAFKA-2765) Connectors and tasks should have versions that can be reported when they are instantiated

2015-11-06 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2765: Summary: Connectors and tasks should have versions that can be reported when they are instantiated Key: KAFKA-2765 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Resolved] (KAFKA-2734) kafka-console-consumer throws NoSuchElementException on not specifying topic

2015-11-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2734. -- Resolution: Fixed Fix Version/s: 0.9.0.0 Issue resolved by pull request 412 [https://gith

[jira] [Commented] (KAFKA-2734) kafka-console-consumer throws NoSuchElementException on not specifying topic

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994479#comment-14994479 ] ASF GitHub Bot commented on KAFKA-2734: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2734: kafka-console-consumer throws NoSu...

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/412 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2759) Mirror maker can leave gaps of missing messages if the process dies after a partition is reset and before the first offset commit

2015-11-06 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994473#comment-14994473 ] James Cheng commented on KAFKA-2759: Vaguely related is the behavior in KAFKA-1006. Fr

[GitHub] kafka pull request: KAFKA-2760: Clean up interface of AdminClient....

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/442 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2760) Clean up interface of AdminClient.describeConsumerGroup(groupId

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994456#comment-14994456 ] ASF GitHub Bot commented on KAFKA-2760: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-2760) Clean up interface of AdminClient.describeConsumerGroup(groupId

2015-11-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2760. -- Resolution: Fixed Fix Version/s: 0.9.0.0 Issue resolved by pull request 442 [https://gith

[jira] [Commented] (KAFKA-2759) Mirror maker can leave gaps of missing messages if the process dies after a partition is reset and before the first offset commit

2015-11-06 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994452#comment-14994452 ] Jiangjie Qin commented on KAFKA-2759: - [~ewencp] By the way, committing offset alone o

[jira] [Commented] (KAFKA-2764) Copycat APIs should use Map instead of Properties

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994449#comment-14994449 ] ASF GitHub Bot commented on KAFKA-2764: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2764: Change use of Properties in Copyca...

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/444 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Updated] (KAFKA-2764) Copycat APIs should use Map instead of Properties

2015-11-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2764: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

Re: Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk)

2015-11-06 Thread Guozhang Wang
There is already a patch merged in trunk to change the version numbers, we have not upload it to the kafka-site yet. It will be updated upon the 0.9.0 release. Guozhang On Fri, Nov 6, 2015 at 12:25 AM, Stevo Slavić wrote: > Those docs at https://kafka.apache.org/090/documentation.html#upgrade a

Build failed in Jenkins: kafka-trunk-jdk8 #108

2015-11-06 Thread Apache Jenkins Server
See Changes: [cshapi] KAFKA-2713: Run task start and stop methods in worker threads so they -- [...truncated 136 lines...]

[jira] [Updated] (KAFKA-2761) Enable passing regex via whitelist for new-consumer in ConsoleConsumer

2015-11-06 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-2761: -- Status: Patch Available (was: In Progress) > Enable passing regex via whitelist for new-consume

[jira] [Commented] (KAFKA-2761) Enable passing regex via whitelist for new-consumer in ConsoleConsumer

2015-11-06 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994335#comment-14994335 ] Ashish K Singh commented on KAFKA-2761: --- Created PR, https://github.com/apache/kafka

[jira] [Work started] (KAFKA-2761) Enable passing regex via whitelist for new-consumer in ConsoleConsumer

2015-11-06 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-2761 started by Ashish K Singh. - > Enable passing regex via whitelist for new-consumer in ConsoleConsumer >

[GitHub] kafka pull request: Kafka 2761

2015-11-06 Thread SinghAsDev
GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/445 Kafka 2761 You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAsDev/kafka KAFKA-2761 Alternatively you can review and apply these changes a

[GitHub] kafka pull request: KAFKA-2764: Change use of Properties in Copyca...

2015-11-06 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/444 KAFKA-2764: Change use of Properties in Copycat to Maps. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ewencp/kafka kafka-2764-maps-not-properti

[jira] [Updated] (KAFKA-2764) Copycat APIs should use Map instead of Properties

2015-11-06 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2764: - Status: Patch Available (was: Open) > Copycat APIs should use Map instead of Prop

[jira] [Commented] (KAFKA-2764) Copycat APIs should use Map instead of Properties

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994252#comment-14994252 ] ASF GitHub Bot commented on KAFKA-2764: --- GitHub user ewencp opened a pull request:

[jira] [Created] (KAFKA-2764) Copycat APIs should use Map instead of Properties

2015-11-06 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2764: Summary: Copycat APIs should use Map instead of Properties Key: KAFKA-2764 URL: https://issues.apache.org/jira/browse/KAFKA-2764 Project: Kafka

[jira] [Updated] (KAFKA-2713) Copycat worker should not call connector's/task's start methods in the control thread

2015-11-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2713: Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 44

[jira] [Commented] (KAFKA-2713) Copycat worker should not call connector's/task's start methods in the control thread

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994156#comment-14994156 ] ASF GitHub Bot commented on KAFKA-2713: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-2713: Run task start and stop methods in...

2015-11-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/443 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Created] (KAFKA-2763) Reduce stream task migrations and initialization costs

2015-11-06 Thread Yasuhiro Matsuda (JIRA)
Yasuhiro Matsuda created KAFKA-2763: --- Summary: Reduce stream task migrations and initialization costs Key: KAFKA-2763 URL: https://issues.apache.org/jira/browse/KAFKA-2763 Project: Kafka Is

Re: New and updated producers and consumers

2015-11-06 Thread Cliff Rhyne
Adding more context, with the 0.8.2.1 consumers to find the number of pending messages, we perform an OffsetFetchRequest to get the last committed offset and an OffsetRequest to get the last offset in the log. I see that the new KafkaConsumer does a good job at replacing the OffsetFetchRequest (wi

[jira] [Commented] (KAFKA-2713) Copycat worker should not call connector's/task's start methods in the control thread

2015-11-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993955#comment-14993955 ] ASF GitHub Bot commented on KAFKA-2713: --- GitHub user ewencp opened a pull request:

[jira] [Updated] (KAFKA-2713) Copycat worker should not call connector's/task's start methods in the control thread

2015-11-06 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2713: - Status: Patch Available (was: Open) > Copycat worker should not call connector's/

[GitHub] kafka pull request: KAFKA-2713: Run task start and stop methods in...

2015-11-06 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/443 KAFKA-2713: Run task start and stop methods in worker threads so they execute in parallel and cannot block the herder thread. You can merge this pull request into a Git repository by running: $

Re: Pointer to stream data from Kafka to HDFS

2015-11-06 Thread Neha Narkhede
Kevin, In the forthcoming 0.9 release, the community is adding a new ingest/export feature to help with importing and exporting data to and from Kafka. The

Re: Pointer to stream data from Kafka to HDFS

2015-11-06 Thread Damian Guy
Hi, Assuming you are using Avro then you might want to take a look at: https://github.com/confluentinc/camus If not you can still adopt the pattern used to get data into HDFS. We use something similar at my place of employment. Thanks, Damian On 6 November 2015 at 08:46, Woodbine, Kevin wrote:

Pointer to stream data from Kafka to HDFS

2015-11-06 Thread Woodbine, Kevin
Dear Sirs, I'm working on a development project for my company that is looking at the possibility of live streaming transaction data from our Oracle databases into Hadoop HDFS. Doing some research I've been looking into leveraging the power of Kafka to form part of the solution and need some

Re: No log appender for zookeeper in the log4j properties

2015-11-06 Thread Flavio Junqueira
Hi Raju, Thanks for reporting the issue. There are two parts to ZK: client and server. I think your comments refer to the server logs, but you may also care about the ZK client events. In any case, I had a look at the script and the log4j properties in the Apache Kafka code base, and it does lo

[jira] [Updated] (KAFKA-2762) Add a log appender for zookeeper in the log4j.properties file

2015-11-06 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raju Bairishetti updated KAFKA-2762: Summary: Add a log appender for zookeeper in the log4j.properties file (was: Add an log app

Re: No log appender for zookeeper in the log4j properties

2015-11-06 Thread Raju Bairishetti
Sorry, I have just realized that order of starting kafka server and zookeeper does not matter as we are exporting the KAFKA_LOG4J_OPTS is exported from both startup scripts. It always picks up log4j file if we do not specify KAFKA_LOG4J_OPTS. I am using confluent data platform ( for Kafka). They a

[jira] [Created] (KAFKA-2762) Add an log appender for zookeeper in the log4j.properties file

2015-11-06 Thread Raju Bairishetti (JIRA)
Raju Bairishetti created KAFKA-2762: --- Summary: Add an log appender for zookeeper in the log4j.properties file Key: KAFKA-2762 URL: https://issues.apache.org/jira/browse/KAFKA-2762 Project: Kafka

No log appender for zookeeper in the log4j properties

2015-11-06 Thread Raju Bairishetti
Hello dev, I have recently started working on the kafka. I am finding the log4j properties under config directory. We are using this log4j file from the respective daemon scripts. Ex: kaka-server-start.sh & zookeeper-start.sh scripts. I am not seeing any log appender for zookeeper daemon in the

Re: Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk)

2015-11-06 Thread Stevo Slavić
Those docs at https://kafka.apache.org/090/documentation.html#upgrade ate still mentioning 0.8.3 instead of 0.9.0. Is there JIRA already to fix this? On Thu, Nov 5, 2015 at 9:28 PM, Grant Henke wrote: > Hi Matthew, > > I have not read into the details of your issues but have done similar > "roll