[jira] [Commented] (KAFKA-48) Implement optional "long poll" support in fetch request

2012-04-17 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256099#comment-13256099 ] Jay Kreps commented on KAFKA-48: Joel, this is great feedback. I will address these issues i

[jira] [Commented] (KAFKA-301) Implement the broker startup procedure

2012-04-13 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253467#comment-13253467 ] Jay Kreps commented on KAFKA-301: - Here are some superficial comments: 1. This adds more ka

[jira] [Commented] (KAFKA-246) log configuration values used

2012-04-12 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13252909#comment-13252909 ] Jay Kreps commented on KAFKA-246: - Thanks for the patch! I wonder if instead of adding a l

[jira] [Commented] (KAFKA-48) Implement optional "long poll" support in fetch request

2012-04-10 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250982#comment-13250982 ] Jay Kreps commented on KAFKA-48: Hey Neha, yes, my hope is to get the patch evaluated as is,

[jira] [Commented] (KAFKA-48) Implement optional "long poll" support in fetch request

2012-04-10 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250878#comment-13250878 ] Jay Kreps commented on KAFKA-48: Good point Jun, now it is if(w == null) Seq.empty

[jira] [Commented] (KAFKA-266) Kafka web console design

2012-03-14 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13229629#comment-13229629 ] Jay Kreps commented on KAFKA-266: - My take is that, as Joe says, most serious folks already

[jira] [Commented] (KAFKA-293) Allow to configure all broker ids at once similar to how zookeeper handles server ids

2012-03-09 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226547#comment-13226547 ] Jay Kreps commented on KAFKA-293: - The current approach is, admittedly, hacky; but the zook

[jira] [Commented] (KAFKA-266) Kafka web console design

2012-03-09 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226543#comment-13226543 ] Jay Kreps commented on KAFKA-266: - yeah i will post a patch. > Kafka web c

[jira] [Commented] (KAFKA-281) support multiple root log directories

2012-03-09 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226535#comment-13226535 ] Jay Kreps commented on KAFKA-281: - Is this to work around the max subdirectory limits some

[jira] [Commented] (KAFKA-280) change on-disk log layout to {log.dir}/topicname/partitionid

2012-03-09 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226529#comment-13226529 ] Jay Kreps commented on KAFKA-280: - FWIW, I think this new proposal is esthetically nicer to

[jira] [Commented] (KAFKA-45) Broker startup, leader election, becoming a leader/follower for intra-cluster replication

2012-03-09 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226523#comment-13226523 ] Jay Kreps commented on KAFKA-45: I think we are overthinking this. Currently cleanup is not

[jira] [Commented] (KAFKA-266) Kafka web console design

2012-02-07 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202937#comment-13202937 ] Jay Kreps commented on KAFKA-266: - I think this would be fantastic to have. We don't have s

[jira] [Commented] (KAFKA-240) implement new producer and consumer request format

2012-02-07 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202586#comment-13202586 ] Jay Kreps commented on KAFKA-240: - Hey Prashanth, this is great. Question do we need a buil

[jira] [Commented] (KAFKA-48) Implement optional "long poll" support in fetch request

2012-02-03 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13200159#comment-13200159 ] Jay Kreps commented on KAFKA-48: Two other issues with this patch, I forgot to mention: - Th

[jira] [Commented] (KAFKA-48) Implement optional "long poll" support in fetch request

2012-02-03 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13200155#comment-13200155 ] Jay Kreps commented on KAFKA-48: Hey Taylor, here are the nitty gritty details: - When a fet

[jira] [Commented] (KAFKA-240) implement new producer and consumer request format

2012-02-03 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13200128#comment-13200128 ] Jay Kreps commented on KAFKA-240: - Cool, I have a draft of long-poll support in KAFKA-48. I

[jira] [Commented] (KAFKA-261) Corrupted request shuts down the broker

2012-02-01 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198501#comment-13198501 ] Jay Kreps commented on KAFKA-261: - +1 > Corrupted request shuts down the b

[jira] [Commented] (KAFKA-259) Give better error message when trying to run shell scripts without having built/downloaded the jars yet

2012-02-01 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197972#comment-13197972 ] Jay Kreps commented on KAFKA-259: - Yeah, I didn't mean that in a snotty way, just that if w

[jira] [Commented] (KAFKA-260) Add audit trail to kafka

2012-02-01 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197963#comment-13197963 ] Jay Kreps commented on KAFKA-260: - Good point. No, in the sense that I am basically just de

[jira] [Commented] (KAFKA-259) Exception in thread "main" java.lang.NoClassDefFoundError: kafka/Kafka Caused by: java.lang.ClassNotFoundException: kafka.Kafka

2012-01-31 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197344#comment-13197344 ] Jay Kreps commented on KAFKA-259: - This is covered in the README and the releases come with

[jira] [Commented] (KAFKA-202) Make the request processing in kafka asynchonous

2012-01-13 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13185842#comment-13185842 ] Jay Kreps commented on KAFKA-202: - Hey Neha, 0.8 doesn't build for me and is missing a few

[jira] [Commented] (KAFKA-238) add a getTopicMetaData method in broker and expose it to producer

2012-01-05 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180736#comment-13180736 ] Jay Kreps commented on KAFKA-238: - One general recommendation I have is that we think about

[jira] [Commented] (KAFKA-229) SimpleConsumer is not logging exceptions correctly so detailed stack trace is not coming in the logs

2012-01-02 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13178537#comment-13178537 ] Jay Kreps commented on KAFKA-229: - +1 committed. > SimpleConsumer is not l

[jira] [Commented] (KAFKA-200) Support configurable send / receive socket buffer size in server

2011-12-13 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168590#comment-13168590 ] Jay Kreps commented on KAFKA-200: - But yes, the way TCP is supposed to work is that it take

[jira] [Commented] (KAFKA-200) Support configurable send / receive socket buffer size in server

2011-12-13 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168589#comment-13168589 ] Jay Kreps commented on KAFKA-200: - Interesting. Can we validate the setting directly by che

[jira] [Commented] (KAFKA-197) Embedded consumer doesn't shut down if the server can't start

2011-12-04 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162616#comment-13162616 ] Jay Kreps commented on KAFKA-197: - A less invasive way would just be to have the embedded c

[jira] [Commented] (KAFKA-222) Mavenize contrib

2011-12-04 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162613#comment-13162613 ] Jay Kreps commented on KAFKA-222: - Don't we need to do the same thing now on Josh's patch?

[jira] [Commented] (KAFKA-197) Embedded consumer doesn't shut down if the server can't start

2011-12-04 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162587#comment-13162587 ] Jay Kreps commented on KAFKA-197: - I don't think we want to call halt(), that is like kill

[jira] [Commented] (KAFKA-217) Client test suite

2011-11-29 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159444#comment-13159444 ] Jay Kreps commented on KAFKA-217: - Thread is here: http://mail-archives.apache.org/mod_mbo

[jira] [Commented] (KAFKA-212) IllegalThreadStateException in topic watcher for Kafka mirroring

2011-11-28 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158699#comment-13158699 ] Jay Kreps commented on KAFKA-212: - I don't think that answers my question, though, which is

[jira] [Commented] (KAFKA-212) IllegalThreadStateException in topic watcher for Kafka mirroring

2011-11-23 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156276#comment-13156276 ] Jay Kreps commented on KAFKA-212: - Any thread that doesn't shut down cleanly will leak, is

[jira] [Commented] (KAFKA-210) javaapi ZookeeperConsumerConnectorTest duplicates many tests in the scala version

2011-11-23 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155990#comment-13155990 ] Jay Kreps commented on KAFKA-210: - Sounds good. +1 > javaapi ZookeeperCons

[jira] [Commented] (KAFKA-134) Upgrade Kafka to sbt 0.10.1

2011-11-23 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155989#comment-13155989 ] Jay Kreps commented on KAFKA-134: - Well either way. The problem is I am totally lost in SBT

[jira] [Commented] (KAFKA-134) Upgrade Kafka to sbt 0.10.1

2011-11-23 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155953#comment-13155953 ] Jay Kreps commented on KAFKA-134: - So Neha, can you review this patch. I would love to get

[jira] [Commented] (KAFKA-204) BoundedByteBufferReceive hides OutOfMemoryError

2011-11-22 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155740#comment-13155740 ] Jay Kreps commented on KAFKA-204: - We have request limits in the server and consumer that s

[jira] [Commented] (KAFKA-204) BoundedByteBufferReceive hides OutOfMemoryError

2011-11-22 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155739#comment-13155739 ] Jay Kreps commented on KAFKA-204: - I understand the intent, but the important thing here is

[jira] [Commented] (KAFKA-210) javaapi ZookeeperConsumerConnectorTest duplicates many tests in the scala version

2011-11-22 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155737#comment-13155737 ] Jay Kreps commented on KAFKA-210: - Is this approach better than trying to abstract over the

[jira] [Commented] (KAFKA-200) Support configurable send / receive socket buffer size in server

2011-11-22 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155736#comment-13155736 ] Jay Kreps commented on KAFKA-200: - Hey John, can you validate that this setting actually wo

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2011-11-22 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155687#comment-13155687 ] Jay Kreps commented on KAFKA-49: So guys, my thought is the best plan of attack would be ful

[jira] [Commented] (KAFKA-176) Fix existing perf tools

2011-11-22 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155674#comment-13155674 ] Jay Kreps commented on KAFKA-176: - +1 > Fix existing perf tools >

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2011-11-22 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155331#comment-13155331 ] Jay Kreps commented on KAFKA-49: Hi Taylor, as you say the request id was meant to be the ve

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2011-11-22 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155286#comment-13155286 ] Jay Kreps commented on KAFKA-49: +1 for returning the offset If we are changing the request

[jira] [Commented] (KAFKA-208) Efficient polling mechanism for many topics

2011-11-17 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152122#comment-13152122 ] Jay Kreps commented on KAFKA-208: - Ah, I see, now. So if I understand your need you actuall

[jira] [Commented] (KAFKA-208) Efficient polling mechanism for many topics

2011-11-17 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151896#comment-13151896 ] Jay Kreps commented on KAFKA-208: - Yes, but I was actually hoping to even do a multifetch v

[jira] [Commented] (KAFKA-208) Efficient polling mechanism for many topics

2011-11-16 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151760#comment-13151760 ] Jay Kreps commented on KAFKA-208: - Hey Taylor how does this relate to KAFKA-48 and KAFKA-17

[jira] [Commented] (KAFKA-49) Add acknowledgement to the produce request.

2011-11-15 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151039#comment-13151039 ] Jay Kreps commented on KAFKA-49: If there are any other producer-related changes coming we s

[jira] [Commented] (KAFKA-204) BoundedByteBufferReceive hides OutOfMemoryError

2011-11-15 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150590#comment-13150590 ] Jay Kreps commented on KAFKA-204: - Uh...does anyone know what the motivation of this was or

[jira] [Commented] (KAFKA-174) Add performance suite for Kafka

2011-11-14 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149812#comment-13149812 ] Jay Kreps commented on KAFKA-174: - Chris, following up on this, I need to redo the JMX for

[jira] [Commented] (KAFKA-47) Create topic support and new ZK data structures for intra-cluster replication

2011-11-13 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149456#comment-13149456 ] Jay Kreps commented on KAFKA-47: 1,2. The other approach would be to implement a zk structur

[jira] [Commented] (KAFKA-193) use by name parameter helper for logging and trait to include lazy logging and refactor code to use the new LogHelper

2011-11-13 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149445#comment-13149445 ] Jay Kreps commented on KAFKA-193: - Hmm, have you tried this out? Not sure if that works. Yo

[jira] [Commented] (KAFKA-163) Ruby client needs to support new compression byte

2011-11-12 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149160#comment-13149160 ] Jay Kreps commented on KAFKA-163: - Hi Aaron, I think there is missing licensing info. Can y

[jira] [Commented] (KAFKA-173) Support encoding for non ascii characters

2011-11-12 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149159#comment-13149159 ] Jay Kreps commented on KAFKA-173: - Anyone who can review this? > Support e

[jira] [Commented] (KAFKA-193) use by name parameter helper for logging and trait to include lazy logging and refactor code to use the new LogHelper

2011-11-12 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149120#comment-13149120 ] Jay Kreps commented on KAFKA-193: - Yeah so my recommendations. 1. Let's have the same varia

[jira] [Commented] (KAFKA-193) use by name parameter helper for logging and trait to include lazy logging and refactor code to use the new LogHelper

2011-11-11 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148974#comment-13148974 ] Jay Kreps commented on KAFKA-193: - This looks good to me. One thing I notice is that the t

[jira] [Commented] (KAFKA-48) Implement optional "long poll" support in fetch request

2011-11-11 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148971#comment-13148971 ] Jay Kreps commented on KAFKA-48: Cool, moved it. > Implement optional "long

[jira] [Commented] (KAFKA-201) Support for mirroring from multiple sources

2011-11-11 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148930#comment-13148930 ] Jay Kreps commented on KAFKA-201: - This would be a great feature, we would gladly take a pa

[jira] [Commented] (KAFKA-199) Add a how-to-mirror document

2011-11-10 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148258#comment-13148258 ] Jay Kreps commented on KAFKA-199: - Also, one comment, the bit about using mirroring for sca

[jira] [Commented] (KAFKA-199) Add a how-to-mirror document

2011-11-10 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148256#comment-13148256 ] Jay Kreps commented on KAFKA-199: - This is great! Personally I really prefer the site html

[jira] [Commented] (KAFKA-196) Topic creation fails on large values

2011-11-07 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145951#comment-13145951 ] Jay Kreps commented on KAFKA-196: - I think it would be good just to fully think through esc

[jira] [Commented] (KAFKA-195) change ProducerShell to use high level producer

2011-11-07 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145943#comment-13145943 ] Jay Kreps commented on KAFKA-195: - Why are we doing this? KAFKA-180 is to get rid of this c

[jira] [Commented] (KAFKA-191) Investigate removing the synchronization in Log.flush

2011-11-06 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145022#comment-13145022 ] Jay Kreps commented on KAFKA-191: - Looks like fsync does block writes, which is kind of wea

[jira] [Commented] (KAFKA-191) Investigate removing the synchronization in Log.flush

2011-11-05 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144898#comment-13144898 ] Jay Kreps commented on KAFKA-191: - Neha--Sounds good. I have a patch (since it is just dele

[jira] [Commented] (KAFKA-186) no clean way to getCompressionCodec from Java-the-language

2011-11-04 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144609#comment-13144609 ] Jay Kreps commented on KAFKA-186: - Yes, agreed, I think we can definitely change this but t

[jira] [Commented] (KAFKA-181) Log errors for unrecognized config options

2011-11-01 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141517#comment-13141517 ] Jay Kreps commented on KAFKA-181: - Yes, please yes. I recommend we create a Config object

[jira] [Commented] (KAFKA-171) Kafka producer should do a single write to send message sets

2011-11-01 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141295#comment-13141295 ] Jay Kreps commented on KAFKA-171: - Cool, will clean up imports before checking in. I am goi

[jira] [Commented] (KAFKA-176) Fix existing perf tools

2011-10-31 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140895#comment-13140895 ] Jay Kreps commented on KAFKA-176: - tryCleanupZookeeper looks cut-and-pasted from place to p

[jira] [Commented] (KAFKA-48) Implement optional "long poll" support in fetch request

2011-10-31 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140467#comment-13140467 ] Jay Kreps commented on KAFKA-48: Hi Taylor, Could you give a little more detail on your use

[jira] [Commented] (KAFKA-48) Implement optional "long poll" support in fetch request

2011-10-31 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140419#comment-13140419 ] Jay Kreps commented on KAFKA-48: Yes, these are all good points. The work I have done so far

[jira] [Commented] (KAFKA-168) Support locality in consumer partition assignment algorithm

2011-10-28 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138614#comment-13138614 ] Jay Kreps commented on KAFKA-168: - The broker must have an abstract id not tied to host:por

[jira] [Commented] (KAFKA-171) Kafka producer should do a single write to send message sets

2011-10-26 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13136662#comment-13136662 ] Jay Kreps commented on KAFKA-171: - Yes, I think we should do it. My concern was just that I

[jira] [Commented] (KAFKA-171) Kafka producer should do a single write to send message sets

2011-10-26 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13136223#comment-13136223 ] Jay Kreps commented on KAFKA-171: - Moving off localhost between my mac laptop and dev works

[jira] [Commented] (KAFKA-171) Kafka producer should do a single write to send message sets

2011-10-26 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13136193#comment-13136193 ] Jay Kreps commented on KAFKA-171: - Attached is a draft patch which turns the request into a

[jira] [Commented] (KAFKA-166) Create a tool to jump JMX data to a csv file to help build out performance tests

2011-10-24 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134350#comment-13134350 ] Jay Kreps commented on KAFKA-166: - Yeah, I can change the default to use a dot, I think tha

[jira] [Commented] (KAFKA-133) Publish kafka jar to a public maven repository

2011-10-24 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134320#comment-13134320 ] Jay Kreps commented on KAFKA-133: - Josh, you are seriously my hero. Drinks are owed.

[jira] [Commented] (KAFKA-168) Support locality in consumer partition assignment algorithm

2011-10-24 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134270#comment-13134270 ] Jay Kreps commented on KAFKA-168: - Ideally we would also support rack locality in the parti

[jira] [Commented] (KAFKA-166) Create a tool to jump JMX data to a csv file to help build out performance tests

2011-10-24 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134258#comment-13134258 ] Jay Kreps commented on KAFKA-166: - Yeah, I am not opposed to moving to that metrics package

[jira] [Commented] (KAFKA-150) Confusing NodeExistsException failing kafka broker startup

2011-10-23 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133831#comment-13133831 ] Jay Kreps commented on KAFKA-150: - Hmm, good thinking. But actually I don't think that is h

[jira] [Commented] (KAFKA-164) Config should default to a higher-throughput configuration for log.flush.interval

2011-10-23 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133787#comment-13133787 ] Jay Kreps commented on KAFKA-164: - Err, ignore the random Jmx file in the patch...left over

[jira] [Commented] (KAFKA-166) Create a tool to jump JMX data to a csv file to help build out performance tests

2011-10-22 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133480#comment-13133480 ] Jay Kreps commented on KAFKA-166: - Added draft patch. jkreps-mn:kafka-trunk jkreps$ bin/ka

[jira] [Commented] (KAFKA-50) kafka intra-cluster replication support

2011-10-19 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-50?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13130749#comment-13130749 ] Jay Kreps commented on KAFKA-50: Hey Sharad, your comments are all correct. I think using HD

[jira] [Commented] (KAFKA-160) ZK consumer gets into infinite loop if a message is larger than fetch size

2011-10-18 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13130044#comment-13130044 ] Jay Kreps commented on KAFKA-160: - Hey did I break this? > ZK consumer get

[jira] [Commented] (KAFKA-156) Messages should not be dropped when brokers are unavailable

2011-10-18 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13130026#comment-13130026 ] Jay Kreps commented on KAFKA-156: - I agree it is a good feature! It overlaps somewhat with

[jira] [Commented] (KAFKA-157) Message may be delivered to incorrect partition incase of semantic partitioning

2011-10-17 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129299#comment-13129299 ] Jay Kreps commented on KAFKA-157: - I think the only fix for this is the replication work th

[jira] [Commented] (KAFKA-156) Messages should not be dropped when brokers are unavailable

2011-10-17 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129296#comment-13129296 ] Jay Kreps commented on KAFKA-156: - To clarify what I was saying, the single log would likel

[jira] [Commented] (KAFKA-156) Messages should not be dropped when brokers are unavailable

2011-10-17 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129265#comment-13129265 ] Jay Kreps commented on KAFKA-156: - This would be a good feature to have. I think we will pr

[jira] [Commented] (KAFKA-130) Provide a default producer for receiving messages from STDIN

2011-10-02 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119131#comment-13119131 ] Jay Kreps commented on KAFKA-130: - I will add some docs, can I get a +1 on this?

[jira] [Commented] (KAFKA-130) Provide a default producer for receiving messages from STDIN

2011-10-02 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119023#comment-13119023 ] Jay Kreps commented on KAFKA-130: - Hey Jun, the idea of the properties option is this: we w

[jira] [Commented] (KAFKA-79) Introduce the compression feature in Kafka

2011-10-02 Thread Jay Kreps (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119022#comment-13119022 ] Jay Kreps commented on KAFKA-79: Scott, we would gladly take that feature! The compression i