Re: Running SSL and PLAINTEXT mode together (Kafka 10.2.1)

When you say not able to write to a Kafka broker, do you mean your producer isn't able to produce a message? What does your producer configs look like? What exact exception, error or DEBUG logs do you see when you attempt this? We do use a similar setup, so I do know that such a configuration

Re: messages not being displayed on Console, when using console producer/consumer

btw, one thing i noticed - the behavior when i used Confluent Kafka is different from what i see on Apache Kafka, with Confluent Kafka - i was able to see the messages on the console, also the command-line options seem to be different On Wed, Dec 20, 2017 at 7:19 PM, sham singh wrote: > Hello -

messages not being displayed on Console, when using console producer/consumer

Hello - i'm using Kafka 0.10 & am trying to use the kafka-console-consumer.sh to consume/display the messages produced by kafka-producer-perf-test.sh This seems to be working fine, except that the console is not displaying the text produced. Command used : Console Producer : */usr/hdp/2.5.3.0-37

Re:Re: Producer is blocking at second commitTransaction

It was meaningless, just the copy of the first record. in the real world, the key is bigint type and the primary key of a record. I simplify the real program to make the code smaller. if the transactional message has the problem. the kafka streaming is based on the transactional message, there are

Re: Running SSL and PLAINTEXT mode together (Kafka 10.2.1)

Hi Jaikiran With that config, my internal kafka client can't write to the Kafka broker. What I am looking for is that internal client can write to Kafka topic without having to have any truststore setup, while external kafka client MUST have certificate, and truststore setup and can read only if A

Re: Producer is blocking at second commitTransaction

bq. record = new ProducerRecord<>("test", 0, (long)0, Long.toString(0)); What was the rationale of passing 0 as the third parameter in the second transaction ? Cheers On Wed, Dec 20, 2017 at 5:08 AM, HKT wrote: > Hi, I have runned the program over 10 hours! It doesn't stop. > It ge

Kafka Streams - max.poll.interval.ms defaults to Integer.MAX_VALUE

Hi, According to the documentation, "max.poll.interval.ms" defaults to Integer.MAX_VALUE for Kafka Streams since 0.10.2.1. Considering that the "max.poll.interval.ms" is: 1. A "processing timeout" to control an upper limit for processing a batch of records AND 2. The rebalance timeout th

can a vip be used in front of secured kafka clusters?

has anyone been successful putting a vip in front of kafka clusters which are kerborized and over ssl/tls? (known to work without Kerberos) the goal being to route a client to a different kafka cluster without them needing to know the broker names of both clusters. through testing the closest

Re: Kafka streams for golang

KSQL looks interesting, but sometimes access to the lower level processor api turns out to be the best fit for the problem. On Tue, Dec 19, 2017 at 5:59 PM, Hans Jespersen wrote: > You can call the REST endpoints in KSQL from any programming language. I > wrote some stuff in node.js to call KSQL

Re: Kafka streams for golang

Gleam or beam don't seem to be focused on kafka or are they? Goka looks like the closest analog to kafka streams. Thanks, On Tue, Dec 19, 2017 at 1:13 PM, Robin Bartholdson wrote: > Hi, > > Watching this space as well. > > Here is the current shortlist: > > https://github.com/lovoo/goka

Re: Producer is blocking at second commitTransaction

Hi, I have runned the program over 10 hours! It doesn't stop. It generate 800+MB log, but almost of them is 2017-12-20 20:04:28 [kafka-producer-network-thread | producer-1] DEBUG o.a.k.c.producer.internals.Sender - [Producer clientId=producer-1, transactionalId=hello] Sending transactional reque