Re: Kafka/Hadoop consumers and producers

2013-08-13 Thread Andrew Otto
Andrew, I'm about to dive into figuring out how to use Camus without Avro. Perhaps we should join forces? (Be warned thought! My java fu is low at the moment. :) ). -Ao On Aug 12, 2013, at 11:20 PM, Andrew Psaltis andrew.psal...@webtrends.com wrote: Kam, I am perfectly fine if you pick

Re: Unmap before resizing

2013-08-13 Thread Jay Kreps
Awesome, thanks for the contribution! I posted a few follow-up items on the ticket. -Jay On Mon, Aug 12, 2013 at 10:07 PM, elizabeth elizabeth.m@gmail.comwrote: Hi, I just filed the JIRA as instructed. https://issues.apache.org/jira/browse/KAFKA-1008 Thanks! = Hi, can you file

Re: Kafka/Hadoop consumers and producers

2013-08-13 Thread Kam Kasravi
Thanks Andrew. I upgrade it to use the high level consumer. From: Andrew Psaltis andrew.psal...@webtrends.com To: us...@kafka.apache.org us...@kafka.apache.org; Kam Kasravi kamkasr...@yahoo.com; dev@kafka.apache.org dev@kafka.apache.org; Ken Goodhope

Re: Kafka/Hadoop consumers and producers

2013-08-13 Thread Kam Kasravi
Thanks Andrew - I like the shell wrapper - very clean and simple.  What installs all the kafka dependencies under /usr/share/java? From: Andrew Otto o...@wikimedia.org To: Kam Kasravi kamkasr...@yahoo.com Cc: dev@kafka.apache.org dev@kafka.apache.org; Ken

[jira] [Updated] (KAFKA-992) Double Check on Broker Registration to Avoid False NodeExist Exception

2013-08-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-992: Attachment: KAFKA-992.v10.patch Add the Controller.scala file to kafka.cluster

Re: Kafka/Hadoop consumers and producers

2013-08-13 Thread Andrew Otto
What installs all the kafka dependencies under /usr/share/java? The debian/ work was done mostly by another WMF staffer. We tried and tried to make sbt behave with debian standards, most importantly the one that requires that .debs can be created without needing to connect to the internet,

Re: Kafka/Hadoop consumers and producers

2013-08-13 Thread Kam Kasravi
Thanks - I'll ask on bigtop regarding the .deb requirement - it seems they don't abide by this. I may merge a bit of your work into bigtop-989 if that's ok with you. I do know the bigtop folks  would like to see sbt support. From: Andrew Otto

Re: Kafka/Hadoop consumers and producers

2013-08-13 Thread Andrew Otto
may merge a bit of your work into bigtop-989 if that's ok with you. Merge away! Happy to help. :) I'll ask on bigtop regarding the .deb requirement - it seems they don't abide by this. Yeah, there seems to be a constant struggle between the 'java way' of doing things, e.g. Maven

[jira] [Updated] (KAFKA-1008) Unmap before resizing

2013-08-13 Thread Elizabeth Wei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elizabeth Wei updated KAFKA-1008: - Attachment: unmap-v2.patch Unmap before resizing -

[jira] [Updated] (KAFKA-1008) Unmap before resizing

2013-08-13 Thread Elizabeth Wei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elizabeth Wei updated KAFKA-1008: - Attachment: (was: unmap-v1.patch) Unmap before resizing -

[jira] [Commented] (KAFKA-1008) Unmap before resizing

2013-08-13 Thread Elizabeth Wei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739105#comment-13739105 ] Elizabeth Wei commented on KAFKA-1008: -- Thanks for the feedback! 1 - Currently

[jira] [Commented] (KAFKA-1008) Unmap before resizing

2013-08-13 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739197#comment-13739197 ] Jay Kreps commented on KAFKA-1008: -- Hey Elizabeth, thanks for the patch. Two issues.