[jira] [Updated] (KAFKA-369) remove ZK dependency on producer

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-369: -- Fix Version/s: (was: 0.7.2) 0.8 > remove ZK dependency on producer >

[jira] [Commented] (KAFKA-376) expose different data to fetch requests from the follower replicas and consumer clients

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434184#comment-13434184 ] Jun Rao commented on KAFKA-376: --- Thanks for patch v1. It looks good overall. Some comments:

[jira] [Resolved] (KAFKA-452) follower replica may need to backoff the fetching if leader is not ready yet

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-452. --- Resolution: Duplicate same as kafka-451 > follower replica may need to backoff the fetching i

[jira] [Resolved] (KAFKA-382) Write ordering guarantee violated

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-382. --- Resolution: Not A Problem > Write ordering guarantee violated > - > >

[jira] [Resolved] (KAFKA-258) Remove broker.id from the broker.list config in the Producer

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-258. --- Resolution: Fixed Assignee: Yang Ye fixed as part of kafka-369 > Remove broker.id from

[jira] [Created] (KAFKA-458) remove errorcode from ByteBufferMessageSet

2012-08-14 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-458: - Summary: remove errorcode from ByteBufferMessageSet Key: KAFKA-458 URL: https://issues.apache.org/jira/browse/KAFKA-458 Project: Kafka Issue Type: Sub-task Compo

[jira] [Created] (KAFKA-459) KafkaController.RequestSendThread can throw exception on broker socket

2012-08-14 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-459: - Summary: KafkaController.RequestSendThread can throw exception on broker socket Key: KAFKA-459 URL: https://issues.apache.org/jira/browse/KAFKA-459 Project: Kafka Issue T

[jira] [Commented] (KAFKA-385) RequestPurgatory enhancements - expire/checkSatisfy issue; add jmx beans

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434271#comment-13434271 ] Joel Koshy commented on KAFKA-385: -- Just want to add a comment on metrics overheads of usi

[jira] [Created] (KAFKA-460) ControllerChannelManager needs synchronization btw shutdown and add/remove broker

2012-08-14 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-460: - Summary: ControllerChannelManager needs synchronization btw shutdown and add/remove broker Key: KAFKA-460 URL: https://issues.apache.org/jira/browse/KAFKA-460 Project: Kafka

[jira] [Created] (KAFKA-461) remove support for format for magic byte 0 in 0.8

2012-08-14 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-461: - Summary: remove support for format for magic byte 0 in 0.8 Key: KAFKA-461 URL: https://issues.apache.org/jira/browse/KAFKA-461 Project: Kafka Issue Type: Bug Com

[jira] [Resolved] (KAFKA-371) Creating topic of empty string puts broker in a bad state

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-371. --- Resolution: Fixed > Creating topic of empty string puts broker in a bad state > --

[jira] [Commented] (KAFKA-351) Refactor some new components introduced for replication

2012-08-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434292#comment-13434292 ] Neha Narkhede commented on KAFKA-351: - Jun, The patch didn't apply cleanly on a fresh c

[jira] [Updated] (KAFKA-203) Improve Kafka internal metrics

2012-08-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-203: Affects Version/s: 0.8 > Improve Kafka internal metrics > -- > >

[jira] [Commented] (KAFKA-385) RequestPurgatory enhancements - expire/checkSatisfy issue; add jmx beans

2012-08-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434332#comment-13434332 ] Neha Narkhede commented on KAFKA-385: - Patch v2 doesn't apply cleanly on a fresh checko

[jira] [Commented] (KAFKA-385) RequestPurgatory enhancements - expire/checkSatisfy issue; add jmx beans

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434342#comment-13434342 ] Joel Koshy commented on KAFKA-385: -- Yes - looks like KAFKA-369 went in yesterday. I will n

[jira] [Updated] (KAFKA-330) Add delete topic support

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-330: - Labels: replication tools (was: replication) > Add delete topic support > -

[jira] [Updated] (KAFKA-416) Controller tests throw several zookeeper errors

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-416: - Labels: bugs (was: ) > Controller tests throw several zookeeper errors >

[jira] [Updated] (KAFKA-460) ControllerChannelManager needs synchronization btw shutdown and add/remove broker

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-460: - Labels: bugs (was: ) > ControllerChannelManager needs synchronization btw shutdown and add/remove >

[jira] [Updated] (KAFKA-415) Controller throws NoSuchElementException while marking a broker failed

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-415: - Labels: bugs (was: ) > Controller throws NoSuchElementException while marking a broker failed > -

[jira] [Updated] (KAFKA-356) Create a generic Kafka thread class that includes basic boiler plate code of instantiating and shutting down threads cleanly

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-356: - Labels: optimization (was: ) > Create a generic Kafka thread class that includes basic boiler plate c

[jira] [Resolved] (KAFKA-215) Improve system tests for the mirroring code

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-215. -- Resolution: Won't Fix Should be covered by other jiras in 0.8 > Improve system tests fo

[jira] [Updated] (KAFKA-434) IllegalMonitorStateException in ReplicaManager.makerFollower

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-434: - Labels: bugs (was: ) > IllegalMonitorStateException in ReplicaManager.makerFollower > ---

[jira] [Updated] (KAFKA-203) Improve Kafka internal metrics

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-203: - Labels: tools (was: ) > Improve Kafka internal metrics > -- > >

[jira] [Updated] (KAFKA-459) KafkaController.RequestSendThread can throw exception on broker socket

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-459: - Labels: bugs (was: ) > KafkaController.RequestSendThread can throw exception on broker socket > -

[jira] [Updated] (KAFKA-422) LazyInitProducerTest has transient test failure

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-422: - Labels: bugs (was: ) > LazyInitProducerTest has transient test failure >

[jira] [Updated] (KAFKA-431) LogCorruptionTest.testMessageSizeTooLarge fails occasionally

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-431: - Labels: replication-testing (was: ) > LogCorruptionTest.testMessageSizeTooLarge fails occasionally >

[jira] [Updated] (KAFKA-421) LogRecoveryTest has a transient test failure

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-421: - Labels: replication-testing (was: ) > LogRecoveryTest has a transient test failure >

[jira] [Updated] (KAFKA-396) Mirroring system test fails on 0.8

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-396: - Labels: replication-testing (was: ) > Mirroring system test fails on 0.8 > --

[jira] [Updated] (KAFKA-427) LogRecoverTest.testHWCheckpointWithFailuresSingleLogSegment has transient failure

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-427: - Labels: replication-testing (was: ) > LogRecoverTest.testHWCheckpointWithFailuresSingleLogSegment has

[jira] [Updated] (KAFKA-386) Race condition in accessing ISR

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-386: - Labels: bugs (was: ) > Race condition in accessing ISR > --- > >

[jira] [Updated] (KAFKA-327) Monitoring and tooling for Kafka replication

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-327: - Labels: replication tools (was: replication) > Monitoring and tooling for Kafka replication > ---

[jira] [Updated] (KAFKA-391) Producer request and response classes should use maps

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-391: - Labels: optimization (was: ) > Producer request and response classes should use maps > --

[jira] [Updated] (KAFKA-408) ProducerPerformance does not work with all producer config options

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-408: - Labels: tools (was: ) > ProducerPerformance does not work with all producer config options >

[jira] [Updated] (KAFKA-409) Refactor DefaultEventHandler

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-409: - Labels: optimization (was: ) > Refactor DefaultEventHandler > - > >

[jira] [Commented] (KAFKA-356) Create a generic Kafka thread class that includes basic boiler plate code of instantiating and shutting down threads cleanly

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434357#comment-13434357 ] Jun Rao commented on KAFKA-356: --- The patch seems to miss a new class KafkaThread.

[jira] [Updated] (KAFKA-354) Refactor getter and setter API to conform to the new convention

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-354: - Labels: optimization (was: ) > Refactor getter and setter API to conform to the new convention >

[jira] [Commented] (KAFKA-215) Improve system tests for the mirroring code

2012-08-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434356#comment-13434356 ] Neha Narkhede commented on KAFKA-215: - We probably need a JIRA to merge the existing br

[jira] [Updated] (KAFKA-392) Refactor and optimize system tests

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-392: - Labels: replication-testing (was: ) Probably handled by other jiras in 0.8 but will keep open for now.

[jira] [Updated] (KAFKA-416) Controller tests throw several zookeeper errors

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-416: - Labels: bugs replication-testing (was: bugs) > Controller tests throw several zookeeper errors >

[jira] [Updated] (KAFKA-385) RequestPurgatory enhancements - expire/checkSatisfy issue; add jmx beans

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-385: - Labels: bugs (was: ) > RequestPurgatory enhancements - expire/checkSatisfy issue; add jmx beans > ---

[jira] [Updated] (KAFKA-432) allow consumer to read from followers

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-432: - Labels: optimization (was: ) > allow consumer to read from followers > --

[jira] [Updated] (KAFKA-379) TopicCount.constructTopicCount isn't thread-safe

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-379: - Labels: bugs (was: ) > TopicCount.constructTopicCount isn't thread-safe > ---

[jira] [Commented] (KAFKA-429) Expose JMX operation to set logger level dynamically

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434363#comment-13434363 ] Jay Kreps commented on KAFKA-429: - Makes sense. > Expose JMX operation to

[jira] [Updated] (KAFKA-433) ensurePartitionLeaderOnThisBroker should not access ZK

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-433: - Labels: optimization (was: ) > ensurePartitionLeaderOnThisBroker should not access ZK > -

[jira] [Updated] (KAFKA-347) change number of partitions of a topic online

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-347: - Labels: optimization (was: ) > change number of partitions of a topic online > --

[jira] [Updated] (KAFKA-392) Refactor and optimize system tests

2012-08-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-392: Issue Type: Sub-task (was: Improvement) Parent: KAFKA-440 > Refactor and optimize syste

[jira] [Updated] (KAFKA-376) expose different data to fetch requests from the follower replicas and consumer clients

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-376: - Labels: bugs (was: ) > expose different data to fetch requests from the follower replicas and > cons

[jira] [Updated] (KAFKA-324) enforce broker.id to be a non-negative integer

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-324: - Labels: bugs replication (was: replication) > enforce broker.id to be a non-negative integer > --

[jira] [Updated] (KAFKA-340) ensure ISR has enough brokers during clean shutdown of a broker

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-340: - Labels: optimization (was: ) > ensure ISR has enough brokers during clean shutdown of a broker >

[jira] [Updated] (KAFKA-453) follower replica may need to backoff the fetching if leader is not ready yet

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-453: - Labels: optimization (was: ) > follower replica may need to backoff the fetching if leader is not rea

[jira] [Updated] (KAFKA-458) remove errorcode from ByteBufferMessageSet

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-458: - Labels: optimization (was: ) > remove errorcode from ByteBufferMessageSet > -

[jira] [Updated] (KAFKA-420) maintain HW correctly with only 1 replica in ISR

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-420: - Labels: bugs (was: ) > maintain HW correctly with only 1 replica in ISR > ---

[jira] [Updated] (KAFKA-451) follower replica may need to backoff the fetching if leader is not ready yet

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-451: - Labels: optimization (was: ) > follower replica may need to backoff the fetching if leader is not rea

[jira] [Updated] (KAFKA-344) migration tool from 0.7 to 0.8

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-344: - Labels: tools (was: ) > migration tool from 0.7 to 0.8 > -- > >

[jira] [Updated] (KAFKA-289) reuse topicdata when sending producerrequest

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-289: - Labels: optimization replication wireprotocol (was: replication wireprotocol) > reuse topicdata when

[jira] [Updated] (KAFKA-461) remove support for format for magic byte 0 in 0.8

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-461: - Labels: bugs (was: ) > remove support for format for magic byte 0 in 0.8 > --

[jira] [Updated] (KAFKA-402) Adding handling various kind of exception support at server side

2012-08-14 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-402: -- Attachment: kafka_402_v2.diff Added the KafkaThread.scala file into the svn. > Adding handling

[jira] [Updated] (KAFKA-351) Refactor some new components introduced for replication

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-351: -- Labels: optimization (was: ) > Refactor some new components introduced for replication > -

[jira] [Updated] (KAFKA-351) Refactor some new components introduced for replication

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-351: -- Fix Version/s: 0.8 > Refactor some new components introduced for replication >

[jira] [Updated] (KAFKA-439) @returns was used in scala doc when it should have been @return

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-439: Resolution: Fixed Assignee: Jay Kreps Status: Resolved (was: Patch Available) Fixed on 0.8.

[jira] [Assigned] (KAFKA-434) IllegalMonitorStateException in ReplicaManager.makerFollower

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-434: - Assignee: Jun Rao > IllegalMonitorStateException in ReplicaManager.makerFollower > ---

[jira] [Commented] (KAFKA-437) Unused var statement in ZookeeperConsumerConnectorTest

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434440#comment-13434440 ] Jay Kreps commented on KAFKA-437: - I think this is fixed in 0.8 already. >

[jira] [Assigned] (KAFKA-433) ensurePartitionLeaderOnThisBroker should not access ZK

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-433: - Assignee: Jun Rao > ensurePartitionLeaderOnThisBroker should not access ZK > -

[jira] [Updated] (KAFKA-437) Unused var statement in ZookeeperConsumerConnectorTest

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-437: Resolution: Implemented Assignee: Jay Kreps Status: Resolved (was: Patch Available) > Unu

[jira] [Resolved] (KAFKA-453) follower replica may need to backoff the fetching if leader is not ready yet

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-453. --- Resolution: Duplicate Fix Version/s: 0.8 same as kafka-451 > follower replica may need

[jira] [Closed] (KAFKA-453) follower replica may need to backoff the fetching if leader is not ready yet

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-453. - > follower replica may need to backoff the fetching if leader is not ready yet > -

Re: replication development dashboard

2012-08-14 Thread Joel Koshy
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+replication+development On Mon, Aug 13, 2012 at 5:23 PM, Joel Koshy wrote: > I'm thinking of putting together an 0.8 development dashboard using the > wiki's jiraissues plugin. In order to classify issues, I will need to label > issues as f

[jira] [Resolved] (KAFKA-425) Wrong class name in performance test scripts

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-425. - Resolution: Fixed Fix Version/s: 0.8 Assignee: Jay Kreps Applied to 0.8 >

[jira] [Updated] (KAFKA-42) Support rebalancing the partitions with replication

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-42: - Fix Version/s: 0.8 Labels: optimization (was: ) > Support rebalancing the partitions with replicati

[jira] [Updated] (KAFKA-42) Support rebalancing the partitions with replication

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-42: - Component/s: core > Support rebalancing the partitions with replication > -

[jira] [Updated] (KAFKA-43) Rebalance to preferred broke with intra-cluster replication support

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-43?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-43: - Component/s: core Fix Version/s: 0.8 Labels: optimization (was: ) > Rebalance to preferred br

[jira] [Resolved] (KAFKA-424) Remove invalid mirroring arguments from kafka-server-start.sh

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-424. - Resolution: Fixed Fix Version/s: 0.8 Assignee: Jay Kreps > Remove invalid mirroring ar

[jira] [Updated] (KAFKA-181) Log errors for unrecognized config options

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-181: -- Labels: optimization (was: ) > Log errors for unrecognized config options > ---

[jira] [Updated] (KAFKA-440) Create a regression test framework for distributed environment testing

2012-08-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-440: Labels: replication-testing (was: ) > Create a regression test framework for distributed enviro

[jira] [Updated] (KAFKA-440) Create a regression test framework for distributed environment testing

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-440: - Fix Version/s: 0.8 > Create a regression test framework for distributed environment testing >

[jira] [Commented] (KAFKA-377) some of the dist mirrors are giving a 403

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434473#comment-13434473 ] Jay Kreps commented on KAFKA-377: - Can we close this? > some of the dist m

[jira] [Updated] (KAFKA-376) expose different data to fetch requests from the follower replicas and consumer clients

2012-08-14 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-376: Assignee: Prashanth Menon > expose different data to fetch requests from the follower replicas a

[jira] [Updated] (KAFKA-323) Add the ability to use the async producer in the Log4j appender

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-323: Resolution: Fixed Fix Version/s: 0.8 Assignee: Jay Kreps Status: Resolved (was: P

[jira] [Commented] (KAFKA-313) Add JSON output and looping options to ConsumerOffsetChecker

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434484#comment-13434484 ] Jay Kreps commented on KAFKA-313: - Is JSON better than CSV for this kind of thing? CSV is s

Re: replication development dashboard

2012-08-14 Thread Prashanth Menon
This is pretty awesome, thanks for setting it up Joel! On Tue, Aug 14, 2012 at 3:56 PM, Joel Koshy wrote: > > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+replication+development > > On Mon, Aug 13, 2012 at 5:23 PM, Joel Koshy wrote: > > > I'm thinking of putting together an 0.8 deve

[jira] [Updated] (KAFKA-311) Allow KafkaLog4jAppender to take in a configurable producer.type

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-311: Resolution: Duplicate Fix Version/s: 0.8 Assignee: Jay Kreps Status: Resolved (wa

[jira] [Commented] (KAFKA-181) Log errors for unrecognized config options

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434512#comment-13434512 ] Jay Kreps commented on KAFKA-181: - Can we move the various Utils.get* into VerifiableProper

[jira] [Commented] (KAFKA-313) Add JSON output and looping options to ConsumerOffsetChecker

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434531#comment-13434531 ] Joel Koshy commented on KAFKA-313: -- I worked with Dave on another version of this patch bu

[jira] [Created] (KAFKA-462) ZK thread crashing doesn't bring down the broker (and doesn't come back up).

2012-08-14 Thread Matt Jones (JIRA)
Matt Jones created KAFKA-462: Summary: ZK thread crashing doesn't bring down the broker (and doesn't come back up). Key: KAFKA-462 URL: https://issues.apache.org/jira/browse/KAFKA-462 Project: Kafka

Re: Build failed in Jenkins: Kafka-0.8 #19

2012-08-14 Thread Neha Narkhede
Same issue where one unit test fails to load the snappy libraries On Tue, Aug 14, 2012 at 1:08 PM, Apache Jenkins Server wrote: > See > > Changes: > > [jkreps] KAFKA-424. Fix command line usage description. Patch from Tommie. > > [jkreps] KAFKA

[jira] [Updated] (KAFKA-356) Create a generic Kafka thread class that includes basic boiler plate code of instantiating and shutting down threads cleanly

2012-08-14 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-356: -- Attachment: kafka_356_v2.diff Added the KafkaThread.scala file into the svn > Create a generic

Re: replication development dashboard

2012-08-14 Thread Neha Narkhede
+1. This is very cool ! On Tue, Aug 14, 2012 at 1:40 PM, Prashanth Menon wrote: > This is pretty awesome, thanks for setting it up Joel! > > On Tue, Aug 14, 2012 at 3:56 PM, Joel Koshy wrote: > >> >> https://cwiki.apache.org/confluence/display/KAFKA/Kafka+replication+development >> >> On Mon, Au

[jira] [Commented] (KAFKA-461) remove support for format for magic byte 0 in 0.8

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434592#comment-13434592 ] Jay Kreps commented on KAFKA-461: - I think the message format hasn't changed. Technically w

[jira] [Commented] (KAFKA-385) RequestPurgatory enhancements - expire/checkSatisfy issue; add jmx beans

2012-08-14 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434602#comment-13434602 ] Jay Kreps commented on KAFKA-385: - 1. Can we make the reporters pluggable? We shouldn't har

[jira] [Commented] (KAFKA-356) Create a generic Kafka thread class that includes basic boiler plate code of instantiating and shutting down threads cleanly

2012-08-14 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434603#comment-13434603 ] Jun Rao commented on KAFKA-356: --- Thanks for patch v2. Some comments: 1. KafkaThread: 1.1 Sin

[jira] [Commented] (KAFKA-385) RequestPurgatory enhancements - expire/checkSatisfy issue; add jmx beans

2012-08-14 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434655#comment-13434655 ] Joel Koshy commented on KAFKA-385: -- I'm about to upload a rebased patch so I'd like to inc

[jira] [Updated] (KAFKA-365) change copyright in NOTICE to 2012

2012-08-14 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-365: -- Attachment: kafka_365_v2.diff changed according to the comments > change copyright in NOTICE to

[jira] [Commented] (KAFKA-457) Leader Re-election is broken in rev. 1368092

2012-08-14 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434714#comment-13434714 ] Yang Ye commented on KAFKA-457: --- The behaviour of the code is changed after kafka-369 is chec

[jira] [Updated] (KAFKA-459) KafkaController.RequestSendThread can throw exception on broker socket

2012-08-14 Thread Yang Ye (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Ye updated KAFKA-459: -- Attachment: kafka_459.diff 1. Fix this problem 2. Fix the unnecessary error level logging of "Log.scala" in t