[jira] [Updated] (KAFKA-1141) make changes to downloads for the archive old releases to new old_releases folder

2013-11-26 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1141: - Affects Version/s: 0.7.3 0.7.2 0.8

[jira] [Work started] (KAFKA-1141) make changes to downloads for the archive old releases to new old_releases folder

2013-11-26 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-1141 started by Joe Stein. make changes to downloads for the archive old releases to new old_releases folder

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832775#comment-13832775 ] Jun Rao commented on KAFKA-1144: KAFKA-1000 will allow the consumer to explicitly commit

Re: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-26 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/#review29438 --- Thinking about this a bit more. It seems that a better approach is

[jira] [Resolved] (KAFKA-1141) make changes to downloads for the archive old releases to new old_releases folder

2013-11-26 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein resolved KAFKA-1141. -- Resolution: Fixed all set, downloads page is live with the updates Sent email to Henk that he can

RE: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-26 Thread Guozhang Wang
Does this enforce the key/value decoder to be passed also into MessageAndMetadata? Guozhang From: Jun Rao [nore...@reviews.apache.org] on behalf of Jun Rao [jun...@gmail.com] Sent: Tuesday, November 26, 2013 9:30 AM To: kafka; Jun Rao; Guozhang Wang Subject: Re:

Re: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-26 Thread Jun Rao
Yes, we will have to pass in the decoders to MessageAndMetadata. Thanks, Jun On Tue, Nov 26, 2013 at 10:09 AM, Guozhang Wang guw...@linkedin.com wrote: Does this enforce the key/value decoder to be passed also into MessageAndMetadata? Guozhang -- *From:*

[jira] [Commented] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

2013-11-26 Thread Sean Glover (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832845#comment-13832845 ] Sean Glover commented on KAFKA-903: --- I still see this exception on Windows 7 Pro SP1 with

[jira] [Comment Edited] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

2013-11-26 Thread Sean Glover (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832845#comment-13832845 ] Sean Glover edited comment on KAFKA-903 at 11/26/13 6:53 PM: - I

[jira] [Created] (KAFKA-1145) Broker fail to sync after restart

2013-11-26 Thread David Lao (JIRA)
David Lao created KAFKA-1145: Summary: Broker fail to sync after restart Key: KAFKA-1145 URL: https://issues.apache.org/jira/browse/KAFKA-1145 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-1145) Broker fail to sync after restart

2013-11-26 Thread David Lao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Lao updated KAFKA-1145: - Attachment: broker-3.txt broker-0.txt Broker fail to sync after restart

[jira] [Created] (KAFKA-1146) toString() on KafkaStream gets stuck indefinitely

2013-11-26 Thread Arup Malakar (JIRA)
Arup Malakar created KAFKA-1146: --- Summary: toString() on KafkaStream gets stuck indefinitely Key: KAFKA-1146 URL: https://issues.apache.org/jira/browse/KAFKA-1146 Project: Kafka Issue Type:

[jira] [Comment Edited] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

2013-11-26 Thread Sean Glover (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832845#comment-13832845 ] Sean Glover edited comment on KAFKA-903 at 11/26/13 7:15 PM: - I

[jira] [Created] (KAFKA-1147) Consumer socket timeout should be greater than fetch max wait

2013-11-26 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-1147: - Summary: Consumer socket timeout should be greater than fetch max wait Key: KAFKA-1147 URL: https://issues.apache.org/jira/browse/KAFKA-1147 Project: Kafka Issue

[jira] [Created] (KAFKA-1148) Delayed fetch/producer requests should be satisfied on a leader change

2013-11-26 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-1148: - Summary: Delayed fetch/producer requests should be satisfied on a leader change Key: KAFKA-1148 URL: https://issues.apache.org/jira/browse/KAFKA-1148 Project: Kafka

[jira] [Created] (KAFKA-1149) Please delete old releases from mirroring system

2013-11-26 Thread Sebb (JIRA)
Sebb created KAFKA-1149: --- Summary: Please delete old releases from mirroring system Key: KAFKA-1149 URL: https://issues.apache.org/jira/browse/KAFKA-1149 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-1146) toString() on KafkaStream gets stuck indefinitely

2013-11-26 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1146: -- Fix Version/s: 0.8.1 Yes this is due to KafkaStream being a scala iterable - toString on an iterable

[jira] [Comment Edited] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

2013-11-26 Thread Sean Glover (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832845#comment-13832845 ] Sean Glover edited comment on KAFKA-903 at 11/26/13 7:58 PM: - I

[jira] [Commented] (KAFKA-1146) toString() on KafkaStream gets stuck indefinitely

2013-11-26 Thread Arup Malakar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833003#comment-13833003 ] Arup Malakar commented on KAFKA-1146: - [~jjkoshy] Yes overriding would definitely be

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833068#comment-13833068 ] Imran Rashid commented on KAFKA-1144: - Hi Jun, yes, that will do the trick. I think

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 4

2013-11-26 Thread Joel Koshy
I'm getting this with console consumer in the binary package which seems to be because it was built under Java 7. Can we stick to 6? Exception in thread main java.lang.UnsupportedClassVersionError: kafka/javaapi/consumer/ConsumerConnector : Unsupported major.minor version 51.0 at

Re: [VOTE] Apache Kafka Release 0.8.0 - Candidate 4

2013-11-26 Thread Joe Stein
yes, that is my bad {again}, forgot to use my other vm to build instead of my usual one ... will update the release docs too VOTE canceled, rebuilding for RC5 hopefully out later tonight /*** Joe Stein Founder, Principal Consultant Big Data Open Source

Re: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-26 Thread Guozhang Wang
On Nov. 26, 2013, 2:45 a.m., Jun Rao wrote: core/src/test/scala/unit/kafka/consumer/ConsumerIteratorTest.scala, lines 102-103 https://reviews.apache.org/r/15805/diff/3/?file=390866#file390866line102 We probably should just use ConsumerConfig.ConsumerTimeoutMs here, to make it

[VOTE] Apache Kafka Release 0.8.0 - Candidate 5

2013-11-26 Thread Joe Stein
This is the fifth candidate for release of Apache Kafka 0.8.0. This release candidate is now built from JDK 6 as RC4 was built with JDK 7. Release Notes for the 0.8.0 release http://people.apache.org/~joestein/kafka-0.8.0-candidate5/RELEASE_NOTES.html *** Please download, test and vote by

[jira] [Updated] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1140: - Attachment: KAFKA-1140_2013-11-26_14:41:00.patch Move the decoding logic from

Re: Review Request 15805: KAFKA-1140.v3: addressed more of Jun's comments, changed the API of MessageAndMetadata

2013-11-26 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/ --- (Updated Nov. 26, 2013, 10:41 p.m.) Review request for kafka. Summary

[jira] [Commented] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833172#comment-13833172 ] Guozhang Wang commented on KAFKA-1140: -- Updated reviewboard

Re: Review Request 15805: KAFKA-1140.v3: addressed more of Jun's comments, changed the API of MessageAndMetadata

2013-11-26 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/#review29465 --- core/src/main/scala/kafka/consumer/ConsumerIterator.scala

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-26 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833359#comment-13833359 ] Joel Koshy commented on KAFKA-1144: --- I agree that this is a useful feature. It may be

Re: Review Request 15805: KAFKA-1140.v4

2013-11-26 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/ --- (Updated Nov. 27, 2013, 2:29 a.m.) Review request for kafka. Summary

[jira] [Updated] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1140: - Attachment: KAFKA-1140_2013-11-26_18:29:53.patch Move the decoding logic from

[jira] [Commented] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833373#comment-13833373 ] Guozhang Wang commented on KAFKA-1140: -- Updated reviewboard

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2013-11-26 Thread Andrey Balmin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833401#comment-13833401 ] Andrey Balmin commented on KAFKA-1150: -- Notice that there are two problems here.

[jira] [Created] (KAFKA-1151) The Hadoop consumer API doc is not referencing the contrib consumer

2013-11-26 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1151: Summary: The Hadoop consumer API doc is not referencing the contrib consumer Key: KAFKA-1151 URL: https://issues.apache.org/jira/browse/KAFKA-1151 Project: Kafka

[jira] [Updated] (KAFKA-1151) The Hadoop consumer API doc is not referencing the contrib consumer

2013-11-26 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1151: - Fix Version/s: 0.8.1 The Hadoop consumer API doc is not referencing the contrib consumer

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2013-11-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833474#comment-13833474 ] Jun Rao commented on KAFKA-1150: Right, the first problem (second fetch is needed) is due

[jira] [Commented] (KAFKA-1145) Broker fail to sync after restart

2013-11-26 Thread David Lao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833513#comment-13833513 ] David Lao commented on KAFKA-1145: -- Haven't tried this on the trunk. It takes a while to