I ended up running kafka-reassign-partitions.sh to reassign partitions to
different nodes
On Tue, Mar 10, 2015 at 11:31 AM, sy.pan shengyi@gmail.com wrote:
Hi, tao xiao and Jiangjie Qin
I encounter with the same issue, my node had recovered from high load
problem (caused by other
Hi kafka,
I've started implementing simple materialized views with the log
compaction feature to test it out, and it works great. I'll share the
code and an accompanying article shortly but first wanted to discuss
some of the production implications my sandbox has.
I've separated the project in
How do you typically handle workers starting, always start at offset 0
to make sure the view is correctly recreated ?
--- You will have to reset the offsets to 0 and the offset reset policy to
earliest in consumer.
How do you handle topology changes in consumers, which lead to a
redistribution of
It looks that in your case it is because broker 1 somehow missed a
controller LeaderAndIsrRequest for [ad_click_sts,4]. So the zkVersion
would be different from the value stored in zookeeper from that on.
Therefore broker 1 failed to update ISR. In this case you have to bounce
broker to fix it.
@tao xiao and Jiangjie Qin, Thank you very much
I try to run kafka-reassign-partitions.sh, but the issue still exists…
this the log info:
[2015-03-11 11:00:40,086] ERROR Conditional update of path
/brokers/topics/ad_click_sts/partitions/4/state with data
Hi,
I have an user case where I need to consume a list topics with name that
matches pattern topic.* except for one that is topic.10. Is there a way
that I can combine the use of whitelist and blacklist so that I can achieve
something like accept all topics with regex topic.* but exclude
org.apache.kafka.clients.producer.Producer is the new api producer
On Tue, Mar 10, 2015 at 11:22 PM, Corey Nolet cjno...@gmail.com wrote:
Thanks Jiangie! So what version is considered the new api? Is that the
javaapi in version 0.8.2?.
On Mon, Mar 9, 2015 at 2:29 PM, Jiangjie Qin
Thanks Jiangie! So what version is considered the new api? Is that the
javaapi in version 0.8.2?.
On Mon, Mar 9, 2015 at 2:29 PM, Jiangjie Qin j...@linkedin.com.invalid
wrote:
The stickiness of partition only applies to old producer. In new producer
we have the round robin for each message.
I actually mean if we can achieve this in mirror maker.
On Tue, Mar 10, 2015 at 10:52 PM, tao xiao xiaotao...@gmail.com wrote:
Hi,
I have an user case where I need to consume a list topics with name that
matches pattern topic.* except for one that is topic.10. Is there a way
that I can
Thanks Jun for getting this release out the door and everyone that
contributed to the work in 0.8.2.1, awesome!
~ Joe Stein
- - - - - - - - - - - - - - - - -
http://www.stealth.ly
- - - - - - - - - - - - - - - - -
On Mon, Mar 9, 2015 at 2:12 PM, Jun Rao j...@confluent.io wrote:
The
Good evening. Can someone suggest existing framework that allows to
reliably load data from kafka into relation database like Oracle in real
time?
Thanks so much in advance,
Vadim
If you wanted to use Go you could code a simple worker strategy
https://github.com/stealthly/go_kafka_client/blob/master/consumers/consumers.go#L162-L170
with https://godoc.org/golang.org/x/tools/oracle to-do it and have at
least once insert/update guarantee.
Not sure if you have language
Hi,
Unless the producer is always putting the messages into one partition, I
would expect both consumer groups to read from the topic.
This was the issue. I thought the producer would round robin messages to
different partitions but it must have just been writing to a single partition.
I
Hi,
Code snippet below. This creates two consumers with same group id
consumer-group, they consume from common-topic which has 6 partitions. Each
group has 3 consumers.
However only one of the groups will ever run. Unless the producer is always
putting the messages into one partition, I would
14 matches
Mail list logo
