[
https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmitry Pekar updated KAFKA-1792:
Attachment: (was: rebalance_use_cases.txt)
change behavior of --generate to produce assignment
[
https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14336656#comment-14336656
]
Neha Narkhede commented on KAFKA-1792:
--
+1. To reduce back-n-forth, it is better to
[
https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14336573#comment-14336573
]
Joe Stein commented on KAFKA-1792:
--
[~Dmitry Pekar] we should have this discussion on the
[
https://issues.apache.org/jira/browse/KAFKA-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14336675#comment-14336675
]
Ted Malaska commented on KAFKA-1961:
Let me know if there are any other changes I need
2015-02-06 00:51:30,975 - INFO -
==
2015-02-06 00:51:30,975 - INFO - Exception while running test list index out of
range
2015-02-06 00:51:30,975 - INFO -
==
Traceback (most recent call
Congrats!
On 2/25/15, 11:30 AM, Guozhang Wang wangg...@gmail.com wrote:
+1, very nice!
On Wed, Feb 25, 2015 at 11:20 AM, Sriram Subramanian
srsubraman...@linkedin.com.invalid wrote:
Congratulations!
On 2/25/15 11:15 AM, Joe Stein joe.st...@stealth.ly wrote:
Awesome!
The future of
Congrats guys!
On Wed, Feb 25, 2015 at 11:47 AM, Jiangjie Qin j...@linkedin.com.invalid
wrote:
Congrats!
On 2/25/15, 11:30 AM, Guozhang Wang wangg...@gmail.com wrote:
+1, very nice!
On Wed, Feb 25, 2015 at 11:20 AM, Sriram Subramanian
srsubraman...@linkedin.com.invalid wrote:
Wow, .deb packages. I love you.
On Feb 25, 2015, at 14:48, Joseph Lawson jlaw...@roomkey.com wrote:
This is really awesome stuff. It's great to see y'all growing! Thank you
and congratulations!
From: Neha Narkhede n...@confluent.io
Sent:
Hey guys,
One thing we tried to do along with the product release was start to put
together a practical guide for using Kafka. I wrote this up here:
http://blog.confluent.io/2015/02/25/stream-data-platform-1/
I'd like to keep expanding on this as good practices emerge and we learn
more stuff. So
[
https://issues.apache.org/jira/browse/KAFKA-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14336985#comment-14336985
]
Guozhang Wang commented on KAFKA-1910:
--
The uploaded patch contains multiple fixes to
Congratulations!
On 2/25/15 11:15 AM, Joe Stein joe.st...@stealth.ly wrote:
Awesome!
The future of schema management, has arrived
~ Joestein
On Wed, Feb 25, 2015 at 1:34 PM, Gwen Shapira gshap...@cloudera.com
wrote:
Congrats, Confluent team.
This is super exciting :)
On Wed, Feb
Folks,
We, at Confluent http://confluent.io, are excited to announce the release
of Confluent Platform 1.0 built around Apache Kafka -
http://blog.confluent.io/2015/02/25/announcing-the-confluent-platform-1-0/
We also published a detailed two-part guide on how you can put Kafka to use
in your
Congrats, Confluent team.
This is super exciting :)
On Wed, Feb 25, 2015 at 10:31 AM, Neha Narkhede n...@confluent.io wrote:
Folks,
We, at Confluent http://confluent.io, are excited to announce the
release
of Confluent Platform 1.0 built around Apache Kafka -
Awesome!
The future of schema management, has arrived
~ Joestein
On Wed, Feb 25, 2015 at 1:34 PM, Gwen Shapira gshap...@cloudera.com wrote:
Congrats, Confluent team.
This is super exciting :)
On Wed, Feb 25, 2015 at 10:31 AM, Neha Narkhede n...@confluent.io wrote:
Folks,
We,
Congrats!
-Harsha
On Wed, Feb 25, 2015, at 11:20 AM, Sriram Subramanian wrote:
Congratulations!
On 2/25/15 11:15 AM, Joe Stein joe.st...@stealth.ly wrote:
Awesome!
The future of schema management, has arrived
~ Joestein
On Wed, Feb 25, 2015 at 1:34 PM, Gwen Shapira
I added debug information and the reason is that the array size,
replicaIdxMsgIdList is 2 but the number of files which are being validated are
3.
2015-02-25 00:53:17,882 - INFO - array size: 2 (kafka_system_test_utils)
2015-02-25 00:53:17,882 - INFO - replicaFactor: 2
Hi,
Anyone running tests on Java 8? I just noticed that they take almost twice
as long to run compared to Java 7 (at least on my box, and with Scala
2.10.4).
Anyone else noticed this? Maybe even did some digging on the causes?
Gwen
Congrats!
From: Andrew Otto [ao...@wikimedia.org]
Sent: Wednesday, February 25, 2015 12:06 PM
To: us...@kafka.apache.org
Cc: dev@kafka.apache.org
Subject: Re: Announcing the Confluent Platform built on Apache Kafka
Wow, .deb packages. I love you.
On
See https://builds.apache.org/job/KafkaPreCommit/20/changes
Changes:
[jjkoshy] KAFKA-1953; KAFKA-1962; Disambiguate purgatory metrics; restore
delayed request metrics; reviewed by Guozhang Wang
--
[...truncated 834 lines...]
kafka.admin.AdminTest
[
https://issues.apache.org/jira/browse/KAFKA-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337193#comment-14337193
]
Gwen Shapira commented on KAFKA-1985:
-
Awesome awesome idea.
However, we should also
See https://builds.apache.org/job/Kafka-trunk/407/changes
Changes:
[jjkoshy] KAFKA-1953; KAFKA-1962; Disambiguate purgatory metrics; restore
delayed request metrics; reviewed by Guozhang Wang
--
[...truncated 820 lines...]
[
https://issues.apache.org/jira/browse/KAFKA-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337214#comment-14337214
]
Jay Kreps commented on KAFKA-1985:
--
Totally agree. The documentation for this should
I think this is because it expects the string to be:
baelish-001.edh.cloudera.com:2181,baelish-002.edh.cloudera.com:2181,baelis
h-003.edh.cloudera.com:2181/kafka
I don¹t think you would ever want to have a different root per host.
-Jonathan
On 2/24/15, 1:04 PM, Ashish Singh (JIRA)
[
https://issues.apache.org/jira/browse/KAFKA-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ewen Cheslack-Postava updated KAFKA-1881:
-
Assignee: Ewen Cheslack-Postava (was: Gwen Shapira)
Status: Patch Available
[
https://issues.apache.org/jira/browse/KAFKA-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337455#comment-14337455
]
Ewen Cheslack-Postava commented on KAFKA-1881:
--
Created reviewboard
[
https://issues.apache.org/jira/browse/KAFKA-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ewen Cheslack-Postava updated KAFKA-1881:
-
Attachment: KAFKA-1881.patch
transient unit test failure in
[
https://issues.apache.org/jira/browse/KAFKA-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aditya Auradkar updated KAFKA-1986:
---
Status: Patch Available (was: Open)
Producer request failure rate should not include
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31366/#review74160
---
core/src/main/scala/kafka/server/AbstractFetcherThread.scala
[
https://issues.apache.org/jira/browse/KAFKA-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337608#comment-14337608
]
Gwen Shapira commented on KAFKA-1400:
-
Kinda strange, the TCPDUMP looks the same
[
https://issues.apache.org/jira/browse/KAFKA-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gwen Shapira reopened KAFKA-1400:
-
transient unit test failure in SocketServerTest
---
[
https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337636#comment-14337636
]
Jay Kreps commented on KAFKA-1865:
--
Updated reviewboard
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30763/
---
(Updated Feb. 26, 2015, 1:16 a.m.)
Review request for kafka.
Bugs:
[
https://issues.apache.org/jira/browse/KAFKA-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jay Kreps updated KAFKA-1865:
-
Attachment: KAFKA-1865_2015-02-25_17:15:26.patch
Add a flush() call to the new producer API
[
https://issues.apache.org/jira/browse/KAFKA-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeff Holoman updated KAFKA-1929:
Attachment: KAFKA-1929.patch
Convert core kafka module to use the errors in
[
https://issues.apache.org/jira/browse/KAFKA-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeff Holoman updated KAFKA-1929:
Status: Patch Available (was: Open)
Convert core kafka module to use the errors in
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31306/#review74201
---
core/src/main/scala/kafka/message/ByteBufferMessageSet.scala
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31447/#review74200
---
Ship it!
Ah, now I get what dedupe buffer refers to :)
I never
On Feb. 26, 2015, 3:07 a.m., Gwen Shapira wrote:
Ah, now I get what dedupe buffer refers to :)
I never managed to reproduce the oom, but this looks like the right fix.
This happened consistently for me, which provided good motivation to figure out
how to fix it :) It looks like the
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31460/
---
Review request for kafka.
Bugs: KAFKA-1929
[
https://issues.apache.org/jira/browse/KAFKA-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337828#comment-14337828
]
Jeff Holoman commented on KAFKA-1929:
-
Created reviewboard
+2, these kind of articles coming from the ones who created Kafka always
provide great value to Kafka users and developers. For my 2 cents, I would
love to see one or two articles for developers who involved in Kafka
development on the topics of how to develop test cases and how to run them,
what
I am working on the test handing / NPE / failure issues of ConsumerTest only.
I currently run Java 8 and the unit test takes about 10 minutes, I can do time
./gradlew test with both versions and see if there is a clear difference.
Guozhang
From: Jay Kreps
[
https://issues.apache.org/jira/browse/KAFKA-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337621#comment-14337621
]
Jay Kreps commented on KAFKA-1910:
--
Where is the RB?
Refactor KafkaConsumer
[
https://issues.apache.org/jira/browse/KAFKA-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337379#comment-14337379
]
Jonathan Creasy commented on KAFKA-1664:
I think this is because it expects the
[
https://issues.apache.org/jira/browse/KAFKA-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337382#comment-14337382
]
Jonathan Creasy commented on KAFKA-1664:
nevermind, missed Jun's response farther
[
https://issues.apache.org/jira/browse/KAFKA-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337452#comment-14337452
]
Gwen Shapira commented on KAFKA-1400:
-
and here are the logs :
{code}
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31449/
---
Review request for kafka.
Bugs: KAFKA-1986
[
https://issues.apache.org/jira/browse/KAFKA-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aditya A Auradkar updated KAFKA-1986:
-
Attachment: KAFKA-1986.patch
Producer request failure rate should not include
[
https://issues.apache.org/jira/browse/KAFKA-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337506#comment-14337506
]
Aditya A Auradkar commented on KAFKA-1986:
--
Created reviewboard
[
https://issues.apache.org/jira/browse/KAFKA-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337564#comment-14337564
]
Ewen Cheslack-Postava commented on KAFKA-1978:
--
[~anigam] Can you explain the
Yeah, hey Guozhang, is that fix part of the larger consumer patch you just
posted or is that a separate issue?
-Jay
On Wed, Feb 25, 2015 at 4:25 PM, Gwen Shapira gshap...@cloudera.com wrote:
The Consumer tests are currently hanging :(
I think Guozhang is working on a solution. I'm commenting
I am working on the test handing / NPE / failure issues of ConsumerTest
only as part of the consumer rewriting (KAFKA-1910).
I currently run Java 8 and the unit test takes about 10 minutes, I can do
time ./gradlew test with both versions and see if there is a clear
difference.
Guozhang
On Wed,
Aditya Auradkar created KAFKA-1986:
--
Summary: Producer request failure rate should not include
InvalidMessageSizeException and OffsetOutOfRangeException
Key: KAFKA-1986
URL:
Gwen,
I have not tried Java 8. Still on Java 7, but I always run into the
test hung problems (no errors on the screen and the system is completely
idle), it may be a different problem. I can recreate that problem every
time when I run gradle --daemon testAll, I recall that couple of weeks
ago
[
https://issues.apache.org/jira/browse/KAFKA-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337575#comment-14337575
]
Chad Retz commented on KAFKA-1460:
--
Likewise, embedded Kafka shutdowns (literally
[
https://issues.apache.org/jira/browse/KAFKA-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337652#comment-14337652
]
Gwen Shapira commented on KAFKA-1400:
-
On second thought, why do we even try to detect
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31447/
---
Review request for kafka.
Bugs: KAFKA-1881
Hi Jiangjie,
It might be too late. But, I wanted to bring-up following use case for
adopting new MM:
1) Ability to publish message from src topic to different destination topic
via --overidenTopics=srcTopic:newDestinationTopic
In order to adopt, new MM enhancement customer will compare
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30763/
---
(Updated Feb. 26, 2015, 1:15 a.m.)
Review request for kafka.
Summary
On Feb. 24, 2015, 5:20 p.m., Guozhang Wang wrote:
clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java,
line 379
https://reviews.apache.org/r/30763/diff/4/?file=873436#file873436line379
Can also throw SchemaException.
Yeah I intentionally left this and
For 1), the current design allow you to do it. The customizable message
handler takes in a ConsumerRecord and spit a ListProducerRecord, you can
just put a topic for the ProducerRecord different from ConsumerRecord.
WRT performance, we did some test in LinkedIn, the performance looks good
to us.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/29467/#review74149
---
Could we add some unit tests for this new API, both called by
The Consumer tests are currently hanging :(
I think Guozhang is working on a solution. I'm commenting them out until
the problem is resolved...
On Wed, Feb 25, 2015 at 4:00 PM, Tong Li liton...@us.ibm.com wrote:
Gwen,
I have not tried Java 8. Still on Java 7, but I always run into the
On Feb. 24, 2015, 5:20 p.m., Guozhang Wang wrote:
clients/src/main/java/org/apache/kafka/clients/producer/internals/RecordBatch.java,
line 91
https://reviews.apache.org/r/30763/diff/4/?file=873442#file873442line91
I still think it is kind of waste to create duplicate
On Feb. 26, 2015, 3:07 a.m., Gwen Shapira wrote:
Ah, now I get what dedupe buffer refers to :)
I never managed to reproduce the oom, but this looks like the right fix.
Ewen Cheslack-Postava wrote:
This happened consistently for me, which provided good motivation to
figure out
On Feb. 26, 2015, 3:07 a.m., Gwen Shapira wrote:
Ah, now I get what dedupe buffer refers to :)
I never managed to reproduce the oom, but this looks like the right fix.
Ewen Cheslack-Postava wrote:
This happened consistently for me, which provided good motivation to
figure out
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30763/#review74196
---
Thanks for the patch. A few comments below.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30763/#review74229
---
On Feb. 26, 2015, 3:07 a.m., Gwen Shapira wrote:
Ah, now I get what dedupe buffer refers to :)
I never managed to reproduce the oom, but this looks like the right fix.
Ewen Cheslack-Postava wrote:
This happened consistently for me, which provided good motivation to
figure out
On Feb. 26, 2015, 3:07 a.m., Gwen Shapira wrote:
Ah, now I get what dedupe buffer refers to :)
I never managed to reproduce the oom, but this looks like the right fix.
Ewen Cheslack-Postava wrote:
This happened consistently for me, which provided good motivation to
figure out
70 matches
Mail list logo
