Thanks for reporting the problem!
It did get fixed in current trunk already:
https://issues.apache.org/jira/browse/KAFKA-4366
You could build Kafka Streams from the sources by yourself to check if
the fix resolves your issues.
-Matthias
On 11/17/16 6:10 PM, Ara Ebrahimi wrote:
> This happens
Do you have:
Unclean.leader.election.enable = false ?
Dave
> On Nov 17, 2016, at 19:39, Mark Smith wrote:
>
> Hey folks,
>
> I work at Dropbox and I was doing some maintenance yesterday and it
> looks like we lost some committed data during a preferred replica
> election. As far as I understand
This happens for me too. On 10.1.0. Seems like it just sits there waiting in
the streamThread.join() call.
Ara.
> On Nov 17, 2016, at 6:02 PM, mordac2k wrote:
>
> Hello all,
>
> I have a Java application in which I use an instance of KafkaStreams that
> is working splendidly, under normal circu
Hello all,
I have a Java application in which I use an instance of KafkaStreams that
is working splendidly, under normal circumstances.
However, during development testing, I am using a single kafka instance
(0.10.1.0) as the broker. When this single broker is not running, sending
SIGTERM to my a
Hey folks,
I work at Dropbox and I was doing some maintenance yesterday and it
looks like we lost some committed data during a preferred replica
election. As far as I understand this shouldn't happen, but I have a
theory and want to run it by ya'll.
Preamble:
* Kafka 0.9.0.1
* required.acks = -1
Publish lots of messages and measure in seconds or minutes. Otherwise you are
just benchmarking the initial SSL handshake setup time which should normally be
a one time overhead, not a per message overhead. If you just send one message
then of course SSL is much slower.
-hans
> On Nov 18, 2016
Hi, Hans. I was able to get the command line producer / consumer working
with SSL but I'm not sure how to measure millisecond resolution latency
with them. I thought maybe the '--property print.timestamp=true' argument
would help, but only has second resolution. Do you know of any way to get
th
What is the difference using the bin/kafka-console-producer and
kafka-console-consumer as pub/sub clients?
see http://docs.confluent.io/3.1.0/kafka/ssl.html
-hans
/**
* Hans Jespersen, Principal Systems Engineer, Confluent Inc.
* h...@confluent.io (650)924-2670
*/
On Thu, Nov 17, 2016 at 11:
Pardon if this is a oft repeated issue, but all the information I could
find said I should expect a 20-50% performance hit when using SSL with
kafka, and I am seeing closer to 2000-3000%
I'm trying to get kafka to behave like a fast, secured message bus. So I
am sending small messages, one at a t
We have two Kafka nodes and for reasons outside of this question, would like to
set up a load balancer to terminate SSL with producers (clients). The SSL cert
hosted by the load balancer will be signed by trusted/root CA that clients
should natively trust.
Is this possible to do, or does Kafka
Hi All,
I am facing some strange issues, probably because I am making something
wrong.
Basically, I need to create kafka topics dynamically, post some messages
there and after some time, remove the topic.
1) For creating the topic
private static final int KAFKA_CONNECT_TIMEOUT = 1;
private s
Pro tip: You can't use new (0.10) clients with old (0.7) brokers. They
are incompatible. You will need to easier upgrade your brokers or
downgrade your clients.
On Thu, Nov 17, 2016 at 7:38 AM, Raghav wrote:
> Hello All
>
> I am a new Kafka users, and I am trying to create a publisher that produc
The only way to influence the naming is via application.id which you can
set as you wish. Hope this is good enough to meet your naming conventions.
As Michael mentioned, there is no way to manually specify internal topic
names right now.
-Matthias
On 11/17/16 8:45 AM, Srikanth wrote:
> That is r
Hi Raghav,
Have a look at AdminUtils:
https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/AdminUtils.scala
–
Best regards,
Radek Gruchalski
ra...@gruchalski.com
On November 17, 2016 at 5:58:34 PM, Raghav (raghavas...@gmail.com) wrote:
Hi
I want to be able to create a to
Hi
I want to be able to create a topic, if it doesn't exist already ? Is this
going to be a two step process of first getting list of topics, and then
creating one if it doesn't exist ?
Is there an api which takes a topic name and created only if it's not
present ? I am doing this stuff in Java.
That is right Michael. Most teams that use kafka library can adhere to
certain naming convention.
Using streams API will break that.
Srikanth
On Wed, Nov 16, 2016 at 2:32 PM, Michael Noll wrote:
> Srikanth,
>
> no, there's isn't any API to control the naming of internal topics.
>
> Is the reaso
Hello All
I am a new Kafka users, and I am trying to create a publisher that produces
a bunch of messages from a store and pushes it to broker.
I am looking for best practices in writing a Kafka Producer. I looked at
sample examples, and got confused because different versions of Kafka have
used
on my side I've seen this kind of error while using* ./kafka-consumer-groups.sh
--new-consumer*
from* kafka_2.11-0.10.1.0/bin *on a kafka cluster that was from a pre*
10.1.0 *version
Error while executing consumer group command Request GROUP_COORDINATOR
> failed on brokers List(kazoo002.olaasia.pr
Hello,
I would like to ask you a question related to the size of Kafka stream. I
want to put a large file data (e.g., file *.csv) to Kafka then use Spark
streaming to get the output from Kafka.
The file size is about 100MB with ~250K messages/rows (Each row has about
10 fields of integer).
I see t
19 matches
Mail list logo
