first build a broker, then try your example
---Original---
From: "Andy"
Date: 2018/2/9 07:45:11
To: "users";
Subject: How start with Kafka?
I am Kafka beginner.
I have compiled under Windows and Visual Studio 2015 librdkafka and
cppkafka .
I have two examples: kafka_consumer.cpp and kafka_pr
Hi Experts,
We know that kafka use memory mapped files for it's index files ,however it's
log files don't use the memory mapped files technology.
May I know why index files use memory mapped files, however log files don't
use the same technology?
Jacky
I assume you did start a local Kafka cluster?
Besides that, the client docs might help:
https://docs.confluent.io/current/clients/
They contain examples for librdkafka, too.
Otherwise, your question is hard to answer as there is not enough
information.
-Matthias
On 2/8/18 3:44 PM, Andy wrote:
I think Paolo's comment is correct.
BTW the paragraph above the figure says
Kafka currently lacks transactions
The above seems to have been written some time ago.
Cheers
On Thu, Feb 8, 2018 at 2:10 PM, adrien ruffie
wrote:
> I take a look the errata page, and I saw that Paolo had already ent
Asking again to find out if there is a setting in KAFKA which can handle
this case automatically.
On Sat, Feb 3, 2018 at 12:45 PM, Devendar Rao
wrote:
> Hi,
>
> I don't see partition rebalancing happening when both leader and replica
> nodes are down for a given partition. The partition's leader
Have you seen this thread ?
http://search-hadoop.com/m/Kafka/uyzND1pHiNuYt8hc1?subj=Re+Question+Kafka+Reassign+partitions+tool
On Thu, Feb 8, 2018 at 4:12 PM, Dylan Martin
wrote:
> Hi all.
>
>
> I'm trying to cancel a failed partition reassignment. I've heard that
> this can be done by deletin
Hi all.
I'm trying to cancel a failed partition reassignment. I've heard that this can
be done by deleting /admin/reassign_partitions in zookeeper. I've tried and
/admin/reassign_partitions won't go away.
Does anyone know a way to cancel a partition reassignment?
-Dylan
(206) 855-9740 -
I am Kafka beginner.
I have compiled under Windows and Visual Studio 2015 librdkafka and
cppkafka .
I have two examples: kafka_consumer.cpp and kafka_producer.cpp.
I try:
>producer -b 127.0.0.1:9092 -t topic
>consumer -b 127.0.0.1:9092 -t topic -g group
but is bad connection
I did not write the book, but I agree with the reported errata.
-Matthias
On 2/8/18 2:10 PM, adrien ruffie wrote:
> I take a look the errata page, and I saw that Paolo had already entered the
> errata. But is unconfirmed for the moment
>
>
> PDF Page 166
> Figure 8-5
>
> The labels on th
I take a look the errata page, and I saw that Paolo had already entered the
errata. But is unconfirmed for the moment
PDF Page 166
Figure 8-5
The labels on the topics/partitions are all the same: "Topic A, Partition 0". I
think they should be (from top to bottom): "Topic A, Partition 0" "T
Thank Matthias,
I know books can contain errors, and I'm not really sure about this errors,
that's why I asked the question 😊
De : Matthias J. Sax
Envoyé : jeudi 8 février 2018 22:19:59
À : users@kafka.apache.org
Objet : Re: mistake in Kafka the definitive guid
Books can contain errors...
Check the reported Errata and add a new one if not reported yet:
http://www.oreilly.com/catalog/errata.csp?isbn=0636920044123
-Matthias
On 2/8/18 1:14 PM, adrien ruffie wrote:
> Hello all,
>
>
> I'm reading Kafka the definitive guide and I suspect that found an err
Hello all,
I'm reading Kafka the definitive guide and I suspect that found an error in the
page 166 figure "Figure 8-5 a fail over causes committed offsets without
matching records".
In the figure we can't see Topic B ... specified in the box "Group C1, Topic B,
Parition 0, Offset 6" ... the
Hi,
I recently switched my Kafka Streams 1.0.0 app to use exactly_once
semantics and since them my cluster has been stuck in rebalancing. Is
there an explanation as to what is going on, or how I can resolve it?
I saw a similar issue discussed on the mailing list, but I don't know if a
ticket was
Hello Kafka User Community,
In our project(as part of kafka failover evaluation), we have a single cluster
with five kafka nodes (five partition), three consumers (attached to single
group) and single Zookeeper node. As soon as cluster startups, we see leader
election per partition and each co
Thanks very much Luke!
1) In more recent versions of Kafka, the consumer group coordinator runs on
the broker. Previously, there was a "high level consumer" that spoke
directly to zookeeper and did group management within the client libraries,
but this is no longer used.
2) That depends on when your consumer commits off
On Thu, Feb 8, 2018 at 4:27 PM, Luke Steensen <
luke.steen...@braintreepayments.com> wrote:
Offsets are maintained per consumer group. When an individual consumer
> crashes, the consumer group coordinator will detect that failure and
> trigger a rebalance. This redistributes the partitions being c
Offsets are maintained per consumer group. When an individual consumer
crashes, the consumer group coordinator will detect that failure and
trigger a rebalance. This redistributes the partitions being consumed
across the available consumer processes, using the most recently committed
offset for eac
Let's suppose a topic has three partitions and two consumer groups
listening.
The offset maintained by Kafka in each partition is associated with the
consumer group? Or with the individual consumer polling from that partition
in each consumer group respectively?
I am trying to understand the syst
Hi:
I used kafka streaming for real time analysis.
and I put stream_thread_num same with partitions of topic
and set ConsumerConfig.max_poll_records =500
I use foreach method only in this
but find with large records in kafka. the cosumer LAG is big some times and
trigger kafka topic rebalance.
Ho
21 matches
Mail list logo
