[jira] [Commented] (KAFKA-139) cross-compile multiple Scala versions and upgrade to SBT 0.12.1

[ https://issues.apache.org/jira/browse/KAFKA-139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560520#comment-13560520 ] Maxime Brugidou commented on KAFKA-139: --- I checked out 0.8 this morning and this brea

[jira] [Commented] (KAFKA-727) broker can still expose uncommitted data to a consumer

[ https://issues.apache.org/jira/browse/KAFKA-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560806#comment-13560806 ] Neha Narkhede commented on KAFKA-727: - >> I think another fix is to just save the size

[jira] [Commented] (KAFKA-139) cross-compile multiple Scala versions and upgrade to SBT 0.12.1

[ https://issues.apache.org/jira/browse/KAFKA-139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560825#comment-13560825 ] Jun Rao commented on KAFKA-139: --- Also, when running "bin/kafka-console-producer.sh --broker-l

[jira] [Commented] (KAFKA-631) Implement log compaction

[ https://issues.apache.org/jira/browse/KAFKA-631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560901#comment-13560901 ] Neha Narkhede commented on KAFKA-631: - Reviewed patch v4 - 1. CleanerConfig 1.1 Typos

[jira] [Updated] (KAFKA-727) broker can still expose uncommitted data to a consumer

[ https://issues.apache.org/jira/browse/KAFKA-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-727: Labels: p1 (was: ) > broker can still expose uncommitted data to a consumer > -

[jira] [Commented] (KAFKA-713) Update Hadoop producer for Kafka 0.8 changes

[ https://issues.apache.org/jira/browse/KAFKA-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560929#comment-13560929 ] Neha Narkhede commented on KAFKA-713: - Thanks for the rebased patch, Sam. A few minor r

[jira] [Created] (KAFKA-728) System Test (with compression on) Failures due to missing snappy jar path in kafka-run-class.sh

John Fung created KAFKA-728: --- Summary: System Test (with compression on) Failures due to missing snappy jar path in kafka-run-class.sh Key: KAFKA-728 URL: https://issues.apache.org/jira/browse/KAFKA-728 Pro

[jira] [Commented] (KAFKA-726) Add ReplicaFetcherThread name to mbean names

[ https://issues.apache.org/jira/browse/KAFKA-726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560940#comment-13560940 ] Neha Narkhede commented on KAFKA-726: - In ReplicaFetcherThread.scala, the clientId can

[jira] [Created] (KAFKA-729) Gzip compression codec complains about missing SnappyInputStream

John Fung created KAFKA-729: --- Summary: Gzip compression codec complains about missing SnappyInputStream Key: KAFKA-729 URL: https://issues.apache.org/jira/browse/KAFKA-729 Project: Kafka Issue Typ

[jira] [Updated] (KAFKA-716) SimpleConsumerPerformance does not consume all available messages

[ https://issues.apache.org/jira/browse/KAFKA-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-716: Labels: p2 (was: ) > SimpleConsumerPerformance does not consume all available messages > --

[jira] [Updated] (KAFKA-728) System Test (with compression on) Failures due to missing snappy jar path in kafka-run-class.sh

[ https://issues.apache.org/jira/browse/KAFKA-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-728: Attachment: kafka-728.patch Uploaded kafka-728.patch to add the snappy jar path to kafka-run-class.sh such

[jira] [Updated] (KAFKA-728) System Test (with compression on) Failures due to missing snappy jar path in kafka-run-class.sh

[ https://issues.apache.org/jira/browse/KAFKA-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-728: Status: Patch Available (was: Open) > System Test (with compression on) Failures due to missing snappy

[jira] [Assigned] (KAFKA-719) Kafka broker shuts down due to irrecoverable IO error

[ https://issues.apache.org/jira/browse/KAFKA-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede reassigned KAFKA-719: --- Assignee: Jun Rao (was: Jay Kreps) > Kafka broker shuts down due to irrecoverable IO erro

[jira] [Commented] (KAFKA-139) cross-compile multiple Scala versions and upgrade to SBT 0.12.1

[ https://issues.apache.org/jira/browse/KAFKA-139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560999#comment-13560999 ] Jay Kreps commented on KAFKA-139: - It also looks like package no longer builds a test jar(K

[jira] [Commented] (KAFKA-139) cross-compile multiple Scala versions and upgrade to SBT 0.12.1

[ https://issues.apache.org/jira/browse/KAFKA-139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561005#comment-13561005 ] Jay Kreps commented on KAFKA-139: - Also is it right that kafka-run-class is hardcoding ~/.i

[jira] [Updated] (KAFKA-726) Add ReplicaFetcherThread name to mbean names

[ https://issues.apache.org/jira/browse/KAFKA-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapnil Ghike updated KAFKA-726: Attachment: KAFKA-726-v2.patch Set the clientId to name in ReplicaFetcherThread and removed Replica

[jira] [Commented] (KAFKA-708) ISR becomes empty while marking a partition offline

[ https://issues.apache.org/jira/browse/KAFKA-708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561024#comment-13561024 ] Jun Rao commented on KAFKA-708: --- There is a typo logIndent in Logging that causes a compilati

[jira] [Resolved] (KAFKA-726) Add ReplicaFetcherThread name to mbean names

[ https://issues.apache.org/jira/browse/KAFKA-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-726. --- Resolution: Fixed Thanks for patch v2. Committed to 0.8. > Add ReplicaFetcherThread name to m

[jira] [Commented] (KAFKA-139) cross-compile multiple Scala versions and upgrade to SBT 0.12.1

[ https://issues.apache.org/jira/browse/KAFKA-139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561047#comment-13561047 ] Joe Stein commented on KAFKA-139: - ok so first let me review KAFKA-728 and commit it becaus

[jira] [Updated] (KAFKA-727) broker can still expose uncommitted data to a consumer

[ https://issues.apache.org/jira/browse/KAFKA-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-727: Attachment: KAFKA-727-v1.patch Patch v1. 1. Snapshot the size of the log prior to translating the maxOffset

[jira] [Created] (KAFKA-730) Update classpath in "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh"

John Fung created KAFKA-730: --- Summary: Update classpath in "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh" Key: KAFKA-730 URL: https://issues.apache.org/jira/browse/KAFKA-730 Project: Kafk

[jira] [Updated] (KAFKA-730) Update classpath in "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh"

[ https://issues.apache.org/jira/browse/KAFKA-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-730: Attachment: kafka-730.patch Uploaded kafka-730.patch to add classpath for zookeeper jar > U

[jira] [Updated] (KAFKA-730) Update zookeeper classpath in "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh"

[ https://issues.apache.org/jira/browse/KAFKA-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-730: Status: Patch Available (was: Open) > Update zookeeper classpath in > "system_test/migration_tool_test

[jira] [Commented] (KAFKA-133) Publish kafka jar to a public maven repository

[ https://issues.apache.org/jira/browse/KAFKA-133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561100#comment-13561100 ] Scott Carey commented on KAFKA-133: --- 0.8.x needs to depend on a released version of metri

[jira] [Updated] (KAFKA-730) Update zookeeper classpath in "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh"

[ https://issues.apache.org/jira/browse/KAFKA-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-730: Summary: Update zookeeper classpath in "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh" (w

[jira] [Commented] (KAFKA-133) Publish kafka jar to a public maven repository

[ https://issues.apache.org/jira/browse/KAFKA-133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561104#comment-13561104 ] Scott Carey commented on KAFKA-133: --- Additionally, 0.8.x can not be an official Apache re

[jira] [Commented] (KAFKA-727) broker can still expose uncommitted data to a consumer

[ https://issues.apache.org/jira/browse/KAFKA-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561139#comment-13561139 ] Neha Narkhede commented on KAFKA-727: - +1. Minor change before checkin Remove unused im

[jira] [Updated] (KAFKA-708) ISR becomes empty while marking a partition offline

[ https://issues.apache.org/jira/browse/KAFKA-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-708: Status: Patch Available (was: In Progress) > ISR becomes empty while marking a partition offlin

[jira] [Updated] (KAFKA-708) ISR becomes empty while marking a partition offline

[ https://issues.apache.org/jira/browse/KAFKA-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-708: Resolution: Fixed Status: Resolved (was: Patch Available) Fixed the typo, checked in patch

[jira] [Closed] (KAFKA-708) ISR becomes empty while marking a partition offline

[ https://issues.apache.org/jira/browse/KAFKA-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-708. --- > ISR becomes empty while marking a partition offline > --

[jira] [Resolved] (KAFKA-727) broker can still expose uncommitted data to a consumer

[ https://issues.apache.org/jira/browse/KAFKA-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede resolved KAFKA-727. - Resolution: Fixed Checked in patch v1 to proceed with build. > broker can still e

[jira] [Updated] (KAFKA-714) ConsoleConsumer throws SocketTimeoutException when fetching topic metadata

[ https://issues.apache.org/jira/browse/KAFKA-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-714: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch, checked in

[jira] [Closed] (KAFKA-714) ConsoleConsumer throws SocketTimeoutException when fetching topic metadata

[ https://issues.apache.org/jira/browse/KAFKA-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-714. --- > ConsoleConsumer throws SocketTimeoutException when fetching topic metadata > ---

[jira] [Commented] (KAFKA-730) Update zookeeper classpath in "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh"

[ https://issues.apache.org/jira/browse/KAFKA-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561197#comment-13561197 ] Neha Narkhede commented on KAFKA-730: - +1 > Update zookeeper classpath

[jira] [Updated] (KAFKA-730) Update zookeeper classpath in "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh"

[ https://issues.apache.org/jira/browse/KAFKA-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-730: Resolution: Fixed Assignee: John Fung Status: Resolved (was: Patch Available) > U

[jira] [Closed] (KAFKA-730) Update zookeeper classpath in "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh"

[ https://issues.apache.org/jira/browse/KAFKA-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-730. --- > Update zookeeper classpath in > "system_test/migration_tool_testsuite/0.7/bin/kafka-run-class.sh" >

[jira] [Updated] (KAFKA-631) Implement log compaction

[ https://issues.apache.org/jira/browse/KAFKA-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-631: Attachment: KAFKA-631-v5.patch Great review. Attached patch v5 that addresses most of these issues: 1.1 Fix

[jira] [Updated] (KAFKA-728) System Test (with compression on) Failures due to missing snappy jar path in kafka-run-class.sh

[ https://issues.apache.org/jira/browse/KAFKA-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-728: Resolution: Fixed Status: Resolved (was: Patch Available) looks good, committed >

[jira] [Created] (KAFKA-731) ~/ivy2/cache should be a variable in the kafka-run-class bash script

Joe Stein created KAFKA-731: --- Summary: ~/ivy2/cache should be a variable in the kafka-run-class bash script Key: KAFKA-731 URL: https://issues.apache.org/jira/browse/KAFKA-731 Project: Kafka Issu

[jira] [Updated] (KAFKA-720) Migration tool halts

[ https://issues.apache.org/jira/browse/KAFKA-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Subramanian updated KAFKA-720: - Attachment: migrationtoolfix.patch When one of the migration tool thread dies, we were jus

[jira] [Commented] (KAFKA-720) Migration tool halts

[ https://issues.apache.org/jira/browse/KAFKA-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561398#comment-13561398 ] Neha Narkhede commented on KAFKA-720: - Thanks for the patch. There are some compile tim

[jira] [Commented] (KAFKA-696) Fix toString() API for all requests to make logging easier to read

[ https://issues.apache.org/jira/browse/KAFKA-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561412#comment-13561412 ] Neha Narkhede commented on KAFKA-696: - Sorry for a late review. Following are a few rev

[jira] [Closed] (KAFKA-727) broker can still expose uncommitted data to a consumer

[ https://issues.apache.org/jira/browse/KAFKA-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-727. --- > broker can still expose uncommitted data to a consumer > ---

[jira] [Closed] (KAFKA-728) System Test (with compression on) Failures due to missing snappy jar path in kafka-run-class.sh

[ https://issues.apache.org/jira/browse/KAFKA-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-728. --- Assignee: John Fung > System Test (with compression on) Failures due to missing snappy jar path in

[jira] [Closed] (KAFKA-726) Add ReplicaFetcherThread name to mbean names

[ https://issues.apache.org/jira/browse/KAFKA-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-726. --- > Add ReplicaFetcherThread name to mbean names > > >

[jira] [Closed] (KAFKA-693) Consumer rebalance fails if no leader available for a partition and stops all fetchers

[ https://issues.apache.org/jira/browse/KAFKA-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-693. --- > Consumer rebalance fails if no leader available for a partition and stops all > fetchers >

[jira] [Updated] (KAFKA-693) Consumer rebalance fails if no leader available for a partition and stops all fetchers

[ https://issues.apache.org/jira/browse/KAFKA-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-693: Labels: p2 (was: ) > Consumer rebalance fails if no leader available for a partition and stops

[jira] [Updated] (KAFKA-731) ~/ivy2/cache should be a variable in the kafka-run-class bash script

[ https://issues.apache.org/jira/browse/KAFKA-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-731: Attachment: kafka-731.patch > ~/ivy2/cache should be a variable in the kafka-run-class bash script > --

[jira] [Updated] (KAFKA-731) ~/ivy2/cache should be a variable in the kafka-run-class bash script

[ https://issues.apache.org/jira/browse/KAFKA-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-731: Status: Patch Available (was: Open) > ~/ivy2/cache should be a variable in the kafka-run-class bash scr

[jira] [Commented] (KAFKA-720) Migration tool halts

[ https://issues.apache.org/jira/browse/KAFKA-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561425#comment-13561425 ] Sriram Subramanian commented on KAFKA-720: -- The patch seems to have conflicts with

[jira] [Commented] (KAFKA-731) ~/ivy2/cache should be a variable in the kafka-run-class bash script

[ https://issues.apache.org/jira/browse/KAFKA-731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561426#comment-13561426 ] Neha Narkhede commented on KAFKA-731: - I ran quickstart, it worked properly on your pat

[jira] [Closed] (KAFKA-675) Only bind to the interface declared in the 'hostname' config property

[ https://issues.apache.org/jira/browse/KAFKA-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-675. --- > Only bind to the interface declared in the 'hostname' config property >

[jira] [Commented] (KAFKA-651) Create testcases on auto create topics

[ https://issues.apache.org/jira/browse/KAFKA-651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13561433#comment-13561433 ] Neha Narkhede commented on KAFKA-651: - I guess this jira fell between the cracks. John,

[jira] [Assigned] (KAFKA-651) Create testcases on auto create topics

[ https://issues.apache.org/jira/browse/KAFKA-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede reassigned KAFKA-651: --- Assignee: John Fung > Create testcases on auto create topics > ---

dynamic config zookeeper code

Where should the zk code for the dynamic topic config go? I am not sure I understand the overall lay of the land well enough to know if I am doing the right thing. For instance, what the is KafkaZookeeper? What is its domain of responsibility? Should all zk code go there? Lots of other zk code see

Re: dynamic config zookeeper code

TopicConfigWatcher sounds good I still feel there needs to be some abstraction to TopicConfigWather because using Zookeeper Watcher means having global changes to a cluster and in production we don't allow global updates to every server so i am going to have to use another mechanism. How we do ma

[jira] [Updated] (KAFKA-731) ~/ivy2/cache should be a variable in the kafka-run-class bash script

[ https://issues.apache.org/jira/browse/KAFKA-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-731: Resolution: Fixed Status: Resolved (was: Patch Available) good idea, committed > ~