[jira] [Updated] (KAFKA-591) Add test cases to test log size retention and more

2012-10-30 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-591: Description: Add test cases to test the followings: 1. Log Size Retention 2. Replica Factor < no. of broke

[jira] [Updated] (KAFKA-591) Add test cases to test log size retention and more

2012-10-30 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-591: Description: Add test cases to test the followings: 1. Log Size Retention 2. Replica Factor < no. of broke

[jira] [Commented] (KAFKA-188) Support multiple data directories

2012-10-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487307#comment-13487307 ] Jun Rao commented on KAFKA-188: --- Now, some unit tests fail with exceptions like the following

[jira] [Updated] (KAFKA-545) Add a Performance Suite for the Log subsystem

2012-10-30 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-545: Attachment: KAFKA-545-draft.patch Attaching wip that has this command. Usage is: jkreps-mn:kafka-git jkreps

[jira] [Commented] (KAFKA-588) Index truncation doesn't seem to remove the last entry properly

2012-10-30 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487164#comment-13487164 ] Neha Narkhede commented on KAFKA-588: - +1 on v2, good catch ! > Index

[jira] [Updated] (KAFKA-588) Index truncation doesn't seem to remove the last entry properly

2012-10-30 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-588: Attachment: KAFKA-588-v2.patch Same as above patch, but actually has a fix for the issue plus tests that re

[jira] [Commented] (KAFKA-595) Producer side compression is unnecessary

2012-10-30 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487103#comment-13487103 ] Jay Kreps commented on KAFKA-595: - I also think this should be a post 0.8 feature.

[jira] [Commented] (KAFKA-595) Producer side compression is unnecessary

2012-10-30 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487102#comment-13487102 ] Jay Kreps commented on KAFKA-595: - I think saying it is unnecessary is perhaps overstating

[jira] [Commented] (KAFKA-588) Index truncation doesn't seem to remove the last entry properly

2012-10-30 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487086#comment-13487086 ] Jay Kreps commented on KAFKA-588: - Okay, I fooled around a little more and figured it out.

[jira] [Updated] (KAFKA-188) Support multiple data directories

2012-10-30 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-188: Attachment: KAFKA-188-v7.patch Looks like previously if you configured a data directory that didn't exist we

[jira] [Commented] (KAFKA-594) Update System Test due to new argument "--sync" in ProducerPerformance

2012-10-30 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487067#comment-13487067 ] Neha Narkhede commented on KAFKA-594: - Looks good, +1 > Update System

[jira] [Updated] (KAFKA-594) Update System Test due to new argument "--sync" in ProducerPerformance

2012-10-30 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-594: Status: Patch Available (was: Open) > Update System Test due to new argument "--sync" in ProducerPerfor

[jira] [Commented] (KAFKA-594) Update System Test due to new argument "--sync" in ProducerPerformance

2012-10-30 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487065#comment-13487065 ] John Fung commented on KAFKA-594: - Uploaded kafka-594-v1.patch with the following changes:

[jira] [Updated] (KAFKA-594) Update System Test due to new argument "--sync" in ProducerPerformance

2012-10-30 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-594: Attachment: kafka-594-v1.patch > Update System Test due to new argument "--sync" in ProducerPerformance

[jira] [Created] (KAFKA-595) Producer side compression is unnecessary

2012-10-30 Thread Neha Narkhede (JIRA)
Neha Narkhede created KAFKA-595: --- Summary: Producer side compression is unnecessary Key: KAFKA-595 URL: https://issues.apache.org/jira/browse/KAFKA-595 Project: Kafka Issue Type: Bug Affect

Re: CSV metrics

2012-10-30 Thread Joel Koshy
This will be handled in https://issues.apache.org/jira/browse/KAFKA-585 Thanks, Joel On Tue, Oct 30, 2012 at 9:24 AM, Jay Kreps wrote: > I also get this exception over and over again. It's weird because I can > manually create that file so it isn't a permissions issue. In any case the > defaul

[jira] [Commented] (KAFKA-593) Empty log index file created when it shouldn't be empty

2012-10-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486990#comment-13486990 ] Jun Rao commented on KAFKA-593: --- Producer used sync mode. So, there is 1 message per batch an

Re: CSV metrics

2012-10-30 Thread Jay Kreps
I also get this exception over and over again. It's weird because I can manually create that file so it isn't a permissions issue. In any case the default path for metrics data like this should by under /tmp not inside the kafka source directory. java.io.IOException: Unable to create kafka_metrics

[jira] [Created] (KAFKA-594) Update System Test due to new argument "--sync" in ProducerPerformance

2012-10-30 Thread John Fung (JIRA)
John Fung created KAFKA-594: --- Summary: Update System Test due to new argument "--sync" in ProducerPerformance Key: KAFKA-594 URL: https://issues.apache.org/jira/browse/KAFKA-594 Project: Kafka Iss

[jira] [Commented] (KAFKA-188) Support multiple data directories

2012-10-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486921#comment-13486921 ] Jun Rao commented on KAFKA-188: --- Our system tests fail with the latest patch. python -B sys