[
https://issues.apache.org/jira/browse/KAFKA-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624520#comment-15624520
]
Joel Koshy commented on KAFKA-4362:
---
Btw, the summary doesn't make it clear that this al
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624461#comment-15624461
]
Json Tu edited comment on KAFKA-4360 at 11/1/16 6:22 AM:
-
it is wo
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Json Tu updated KAFKA-4360:
---
Reviewer: Json Tu
> Controller may deadLock when autoLeaderRebalance encounter zk expired
> --
Congrats Becket!
-Harsha
On Mon, Oct 31, 2016 at 2:13 PM Rajini Sivaram
wrote:
> Congratulations, Becket!
>
> On Mon, Oct 31, 2016 at 8:38 PM, Matthias J. Sax
> wrote:
>
> > -BEGIN PGP SIGNED MESSAGE-
> > Hash: SHA512
> >
> > Congrats!
> >
> > On 10/31/16 11:01 AM, Renu Tewari wrote:
>
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624461#comment-15624461
]
Json Tu edited comment on KAFKA-4360 at 11/1/16 5:57 AM:
-
it is wo
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624461#comment-15624461
]
Json Tu edited comment on KAFKA-4360 at 11/1/16 5:50 AM:
-
it is wo
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624461#comment-15624461
]
Json Tu edited comment on KAFKA-4360 at 11/1/16 5:49 AM:
-
it is wo
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624461#comment-15624461
]
Json Tu commented on KAFKA-4360:
it is wonderful，I search onControllerResignation() in kaf
[
https://issues.apache.org/jira/browse/KAFKA-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huxi updated KAFKA-4362:
Assignee: Jiangjie Qin (was: huxi)
> Offset commits fail after a partition reassignment
> -
[
https://issues.apache.org/jira/browse/KAFKA-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huxi reassigned KAFKA-4362:
---
Assignee: huxi (was: Jiangjie Qin)
> Offset commits fail after a partition reassignment
> --
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624312#comment-15624312
]
Jiangjie Qin commented on KAFKA-4360:
-
[~Json Tu] Good catch. In terms of the solution
> 在 2016年11月1日，上午10:54，huxi (JIRA) 写道：
>
>
>[
> https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624155#comment-15624155
> ]
>
> huxi commented on KAFKA-4360:
> -
>
> Ex
Hi,
Can someone discuss it in KAFKA-4360, thanks.
> 在 2016年11月1日，上午10:54，huxi (JIRA) 写道：
>
>
> [
> https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624155#comment-15624155
> ]
>
> huxi comment
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Json Tu updated KAFKA-4360:
---
Comment: was deleted
(was: add a deadlock_patch to kafka.)
> Controller may deadLock when autoLeaderRebalance
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Json Tu updated KAFKA-4360:
---
Attachment: deadlock_patch
add a deadlock_patch to kafka.
> Controller may deadLock when autoLeaderRebalance
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624174#comment-15624174
]
Json Tu edited comment on KAFKA-4360 at 11/1/16 3:04 AM:
-
yes，it i
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624174#comment-15624174
]
Json Tu edited comment on KAFKA-4360 at 11/1/16 3:04 AM:
-
yes，I th
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624174#comment-15624174
]
Json Tu commented on KAFKA-4360:
yes，I think we should add a AtomicBoolean variable may be
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624155#comment-15624155
]
huxi commented on KAFKA-4360:
-
Excellent analysis! What I am intrigued is whether this is a de
[
https://issues.apache.org/jira/browse/KAFKA-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623980#comment-15623980
]
huxi commented on KAFKA-4348:
-
No, "Polled 27171 records" is always the first line for the out
[
https://issues.apache.org/jira/browse/KAFKA-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623936#comment-15623936
]
ASF GitHub Bot commented on KAFKA-4352:
---
GitHub user mjsax opened a pull request:
GitHub user mjsax opened a pull request:
https://github.com/apache/kafka/pull/2082
KAFKA-4352: instable ResetTool integration test
- increased timeout to stabelize test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mjsax/kafka
Joel Koshy created KAFKA-4362:
-
Summary: Offset commits fail after a partition reassignment
Key: KAFKA-4362
URL: https://issues.apache.org/jira/browse/KAFKA-4362
Project: Kafka
Issue Type: Bug
GitHub user kkonstantine opened a pull request:
https://github.com/apache/kafka/pull/2081
MINOR: Extend mirror maker test to include interceptors
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kkonstantine/kafka
MINOR-Extend-mi
Xavier,
Yeah I think that post KIP-58 it is possible to depend on the delivery of
messages in compacted topics, if you override the default compaction time.
Prior to that it was true that you could control the delete retention, but
any message including the tombstone could be compacted away prior
[
https://issues.apache.org/jira/browse/KAFKA-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623732#comment-15623732
]
Vahid Hashemian commented on KAFKA-4352:
[This|https://builds.apache.org/job/kafka
Does this make sense given that we still don't have a graceful migration
plan from the old to new consumer?
Different suboptimal migration plans that I can think of are:
1. shutdown all the old consumers of a group first and start them back up
with the new consumer, causing downtime.
2. have a mix
[
https://issues.apache.org/jira/browse/KAFKA-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roger Hoover updated KAFKA-4361:
Description:
For the config params in CONSUMER_DEFAULT_OVERRIDES
(https://github.com/apache/kafka/b
[
https://issues.apache.org/jira/browse/KAFKA-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roger Hoover updated KAFKA-4361:
Description:
For the config params in CONSUMER_DEFAULT_OVERRIDES
(https://github.com/apache/kafka/b
[
https://issues.apache.org/jira/browse/KAFKA-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roger Hoover updated KAFKA-4361:
Description:
For the config params in CONSUMER_DEFAULT_OVERRIDES
(https://github.com/apache/kafka/b
Roger Hoover created KAFKA-4361:
---
Summary: Streams does not respect user configs for "default" params
Key: KAFKA-4361
URL: https://issues.apache.org/jira/browse/KAFKA-4361
Project: Kafka
Issue
Starting to deprecate the old consumer in the next release seems like a
good idea.
Thanks,
Jun
On Tue, Oct 25, 2016 at 2:45 AM, Ismael Juma wrote:
> Hi all,
>
> In 0.10.1.0, we removed the beta label from the new Java consumer
> documentation and updated the various tools so that they can use
Dear all,
currently we are in the processing of benchmarking several stream processing
engines (including but not limited to Kafka Streams, Spark, Flink), and as
such, we require a change to the source code of Kafka used as the input data
source.
Namely, we want to mutate the message payload
[
https://issues.apache.org/jira/browse/KAFKA-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623574#comment-15623574
]
ASF GitHub Bot commented on KAFKA-4302:
---
GitHub user mjsax opened a pull request:
GitHub user mjsax opened a pull request:
https://github.com/apache/kafka/pull/2080
KAFKA-4302: Simplify KTableSource
KTableSource is always materialized since IQ:
- removed flag KTableSource#materialized
- removed MaterializedKTableSourceProcessor
You can merge this pull
GitHub user mjsax opened a pull request:
https://github.com/apache/kafka/pull/2079
HOTFIX: improve error message on invalid input record timestamp
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mjsax/kafka hotfixTSExtractor-0.10
At LinkedIn we've run into some of these problems. We're slowly making our
way towards a solution. It's a little odd in the sense that while it's
possible for some of our clients to block if the cluster is down, sometimes
that is the behavior we need. For us (in production) a cluster down or
unre
Hi Nacho,
yes, exactly.
On Mon, 31 Oct 2016 at 22:10 Nacho Solis
wrote:
> Hi Andrew.
>
> Is this what you're saying:
> - sometimes you get stuck (like a blocking call) when you call some
> function in the kafka client
> - you can go around this case (by wrapping it) such that if the kafka
> cli
Congratulations, Becket!
On Mon, Oct 31, 2016 at 8:38 PM, Matthias J. Sax
wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
>
> Congrats!
>
> On 10/31/16 11:01 AM, Renu Tewari wrote:
> > Congratulations Becket!! Absolutely thrilled to hear this. Well
> > deserved!
> >
> > regards renu
>
Hi Andrew.
Is this what you're saying:
- sometimes you get stuck (like a blocking call) when you call some
function in the kafka client
- you can go around this case (by wrapping it) such that if the kafka
client call gets stuck your software doesn't get stuck
- you're wondering why the kafka clie
Hi Becket,
I asked the same question in the user mailing list and we had a small
discussion there.
We have default timeout for producer and consumer it is 30 secs.
If Kafka is not available we will wait 30 secs on each request.
Decreasing timeout won't help much because we have a lot requests
but
[
https://issues.apache.org/jira/browse/KAFKA-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiangjie Qin updated KAFKA-4340:
Status: Patch Available (was: Open)
> Change the default value of log.message.timestamp.difference.
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512
Congrats!
On 10/31/16 11:01 AM, Renu Tewari wrote:
> Congratulations Becket!! Absolutely thrilled to hear this. Well
> deserved!
>
> regards renu
>
>
> On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy
> wrote:
>
>> The PMC for Apache Kafka has invi
Hi Andrey,
I am not sure I understand the question "why doesn't Kafka client have
the solution
for this kind of problems?" Can you elaborate a little on what kind of
problems are you referring to? And what do you mean by "circuit breaker"
here?
Jiangjie (Becket) Qin
On Fri, Oct 28, 2016 at 12:07
Hi David,
I think the trim() API is generally useful for the consume based retention
as well as other use cases. So we probably should have (1).
For (2), it is more of an optimization by doing a favor for the users. This
could be implemented on top of (1) if we want to. So maybe we can implement
Congrats Becket !
On Mon, Oct 31, 2016 at 7:46 PM, Sriram Subramanian wrote:
> Congratulations!
>
> On Mon, Oct 31, 2016 at 12:23 PM, Ismael Juma wrote:
>
>> Congratulations Becket. :)
>>
>> Ismael
>>
>> On 31 Oct 2016 1:44 pm, "Joel Koshy" wrote:
>>
>> > The PMC for Apache Kafka has invited Ji
Congratulations!
On Mon, Oct 31, 2016 at 12:23 PM, Ismael Juma wrote:
> Congratulations Becket. :)
>
> Ismael
>
> On 31 Oct 2016 1:44 pm, "Joel Koshy" wrote:
>
> > The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
> > committer and we are pleased to announce that he has ac
Congratulations Becket. :)
Ismael
On 31 Oct 2016 1:44 pm, "Joel Koshy" wrote:
> The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
> committer and we are pleased to announce that he has accepted!
>
> Becket has made significant contributions to Kafka over the last two years
Congrats!
On Mon, Oct 31, 2016 at 8:30 PM, Becket Qin wrote:
> Thanks everyone! It is really awesome to be working with you on Kafka!!
>
> On Mon, Oct 31, 2016 at 11:26 AM, Jun Rao wrote:
>
> > Congratulations, Jiangjie. Thanks for all your contributions to Kafka.
> >
> > Jun
> >
> > On Mon, Oc
Let me talk about the container format that we are using here at TiVo to add
headers to our Kafka messages.
Just some quick terminology, so that I don't confuse everyone.
I'm going to use "message body" to refer to the thing returned by
ConsumerRecord.value()
And I'm going to use "payload" to re
Thanks everyone! It is really awesome to be working with you on Kafka!!
On Mon, Oct 31, 2016 at 11:26 AM, Jun Rao wrote:
> Congratulations, Jiangjie. Thanks for all your contributions to Kafka.
>
> Jun
>
> On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote:
>
> > The PMC for Apache Kafka has in
Congratulations Becket!!
Thanks,
Bharat
On Mon, Oct 31, 2016 at 11:26 AM, Jun Rao wrote:
> Congratulations, Jiangjie. Thanks for all your contributions to Kafka.
>
> Jun
>
> On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote:
>
> > The PMC for Apache Kafka has invited Jiangjie (Becket) Qin t
[
https://issues.apache.org/jira/browse/KAFKA-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622940#comment-15622940
]
Bharat Patel commented on KAFKA-4337:
-
HI
I am specifying zookeeperIPS comma separat
Congratulations, Jiangjie. Thanks for all your contributions to Kafka.
Jun
On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote:
> The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
> committer and we are pleased to announce that he has accepted!
>
> Becket has made significa
[
https://issues.apache.org/jira/browse/KAFKA-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bharat Patel reopened KAFKA-4337:
-
> Create topic in multiple zookeepers with Kafka AdminUtils.CreateTopic JAVA
> API in Kafka 0.9.0.1 g
Congratulations Becket!! Absolutely thrilled to hear this. Well deserved!
regards
renu
On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote:
> The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
> committer and we are pleased to announce that he has accepted!
>
> Becket has m
Congrats Becket!
--Vahid
From: Jason Gustafson
To: Kafka Users
Cc: dev@kafka.apache.org
Date: 10/31/2016 10:56 AM
Subject:Re: [ANNOUNCE] New committer: Jiangjie (Becket) Qin
Great work, Becket!
On Mon, Oct 31, 2016 at 10:54 AM, Onur Karaman <
okara...@linkedin.com.inva
Great work, Becket!
On Mon, Oct 31, 2016 at 10:54 AM, Onur Karaman <
okara...@linkedin.com.invalid> wrote:
> Congrats Becket!
>
> On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote:
>
> > The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
> > committer and we are pleased to
Congratulations! well deserved :)
On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote:
> The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
> committer and we are pleased to announce that he has accepted!
>
> Becket has made significant contributions to Kafka over the last tw
Congrats, Becket!
-James
> On Oct 31, 2016, at 10:35 AM, Joel Koshy wrote:
>
> The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
> committer and we are pleased to announce that he has accepted!
>
> Becket has made significant contributions to Kafka over the last two years
Congrats Becket!
On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote:
> The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
> committer and we are pleased to announce that he has accepted!
>
> Becket has made significant contributions to Kafka over the last two years.
> He has
Congrats!
On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote:
> The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
> committer and we are pleased to announce that he has accepted!
>
> Becket has made significant contributions to Kafka over the last two years.
> He has been d
The PMC for Apache Kafka has invited Jiangjie (Becket) Qin to join as a
committer and we are pleased to announce that he has accepted!
Becket has made significant contributions to Kafka over the last two years.
He has been deeply involved in a broad range of KIP discussions and has
contributed sev
Agreed with this approach.
One detail to be wary of is that since we multiplex various other requests
(e.g., heartbeats, offset commits, metadata, etc.) over the client that
connects to the coordinator this could delay some of these critical
requests. Realistically I don't think it will be an issue
GitHub user deragon opened a pull request:
https://github.com/apache/kafka/pull/2078
kafka-run-class.sh can now handle paths containing spaces used in
${CLASSPATH} and in ${JAVA}.
kafka-run-class.sh can now handle paths containing spaces used in
${CLASSPATH} and in ${JAVA}.
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Json Tu updated KAFKA-4360:
---
Description:
when controller has checkAndTriggerPartitionRebalance task in
autoRebalanceScheduler，and then zk
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Json Tu updated KAFKA-4360:
---
Attachment: yf-mafka2-common02_jstack.txt
the jstack file created when kill kafka
> Controller may deadLock w
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622377#comment-15622377
]
Json Tu commented on KAFKA-4360:
[~guozhang] [~junrao] do you think this is may be a bug,
[
https://issues.apache.org/jira/browse/KAFKA-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Json Tu updated KAFKA-4360:
---
Description:
when controller has checkAndTriggerPartitionRebalance task in
autoRebalanceScheduler，and then zk
Json Tu created KAFKA-4360:
--
Summary: Controller may deadLock when autoLeaderRebalance
encounter zk expired
Key: KAFKA-4360
URL: https://issues.apache.org/jira/browse/KAFKA-4360
Project: Kafka
Issu
[
https://issues.apache.org/jira/browse/KAFKA-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622198#comment-15622198
]
Helena Edelson commented on KAFKA-1175:
---
Hoping this hasn't totally fizzled out and
[
https://issues.apache.org/jira/browse/KAFKA-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622015#comment-15622015
]
Yiquan Zhou commented on KAFKA-4348:
Did you get any "polled 0 records" before polling
+1 great KIP
--
Edoardo Comar
IBM MessageHub
eco...@uk.ibm.com
IBM UK Ltd, Hursley Park, SO21 2JN
IBM United Kingdom Limited Registered in England and Wales with number
741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6
3AU
[
https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Guy updated KAFKA-4311:
--
Status: Patch Available (was: Open)
> Multi layer cache eviction causes forwarding to incorrect Process
[
https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15621909#comment-15621909
]
Damian Guy commented on KAFKA-4311:
---
Thanks for confirming
> Multi layer cache eviction
[
https://issues.apache.org/jira/browse/KAFKA-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15621734#comment-15621734
]
huxi commented on KAFKA-4348:
-
interesting... I cannot reproduce on my Mac box. Here is what I
[
https://issues.apache.org/jira/browse/KAFKA-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15621657#comment-15621657
]
Yiquan Zhou commented on KAFKA-4348:
No, the server is started with the default proper
77 matches
Mail list logo
