unsubscribe fro this mailing list

Hi All, Can anyone help me to unsubscribe from this mailing list please. Thank you. Regards Surender

RE: What is the best way to write Kafka data into HDFS?

May be you can try Apache NiFi its quicker as well. Give a try good luck -Original Message- From: R P [mailto:hadoo...@outlook.com] Sent: 11 February 2016 16:09 To: users@kafka.apache.org Subject: Re: What is the best way to write Kafka data into HDFS? Hello Steve, Thanks for the sug

RE: kafka 0.8 producer issue

m the stacktrace:- at com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion( KafkaPDFAProducer.java:62) Please provide more information like a code snippet etc, so that we can tell more Thanks, Prabhjot On Wed, Nov 25, 2015 at 9:24 PM, Kudumula, Surender < surender.kudum...@hpe.com> wrote

kafka 0.8 producer issue

Hi all I am trying to get the producer working. It was working before but now getting the following issue. I have created a new topic as well just in case if it was the issue with topic but still no luck. I have increased the message size in broker as iam trying to send atleast 3mb message here

RE: kafka producer and client use same groupid

Also, consumers consume from partitions of a topic and producers write to partitions in a topic These partitions and the logical abstraction -topic-reside on Kafka and zookeeper respectively Thanks, Prabhjot On Nov 24, 2015 11:38 PM, "Kudumula, Surender" wrote: > Hi all > Is there an

kafka producer and client use same groupid

Hi all Is there anyway we can ensure in 0.8 that kafka remote producer and remote consumer work on the same groupId as my java consumer cannot consume messages from remote producer. Thanks

RE: Java consumer not consuming messages whereas kafka command line client consumes all the messages

hi all Any help will be appreciated guys??? Regards Surender Kudumula Big Data Consultant - EMEA Analytics & Data Management surender.kudum...@hpe.com M +44 7795970923 Hewlett-Packard Enterprise Cain Rd, Bracknell RG12 1HN UK -Original Message- From: Kudumula, Surender Sent

Java consumer not consuming messages whereas kafka command line client consumes all the messages

Hi all I have been trying to think why its happening. Can anyone point me to the right direction in terms of the config iam missing. Producer is on another node in the same cluster and consumer is on different node. But as I said the command line client works and consumes all the messages. If I

kafka java consumer not consuming messsages produced by remote client

Hi all I have a remote java producer producing messages to the same topic where my local kafka java client is subscribed to but it doesn't consume any messages whereas if I ran the consumer from command line I can consume the messages produced by remote client. The following command line consume

issue with javaapi consumer

Hi all Iam currently using kafka 0.8.2.1 consumer which has kafka java api consumer but I had to upgrade to kafka 0.8.2.3 and when I add the jars for kafka 0.8.2.3 my consumer code doesn't compile. consumerConnector = ConsumerConfig

RE: kafka java producer security to access kerberos

ssl properties as a set of key-value pairs. There is some helpful info here <https://cwiki.apache.org/confluence/display/KAFKA/Deploying+SSL+for+Kafka> too B > On 9 Nov 2015, at 15:48, Kudumula, Surender wrote: > > Hi all > Just a quick question is there any way we

kafka java producer security to access kerberos

Hi all Just a quick question is there any way we can pass the security protocol property to java producer client ./bin/kafka-console-producer.sh --broker-list c6401.ambari.apache.org:6667,c6402.ambari.apache.org:6667 --topic test_topic --security-protocol PLAINTEXTSASL Any reply will be apprecia

Producing messages to secured kafka from different node java client in a cluster

Hi all Trying to produce message to secured HDP2.3 kakfa broker from different node using a java producer client but facing below issue any ideas how to configure Kerberos so that I can produce messages to kafka. Thank you. [2015-11-06 07:18:57,435] INFO Closing socket connection to /10.0.2.17.

tips to connect to kafka remotely using java producer

Hi all I have a docker environment and my HDP 2.3 which has kafka works in 4 nodes and I have another two nodes where my application which has kafka producer and consumer sits. I need to talk to Hortonworks HDP2.3 kafka topics and produce and consume messages. I have modified kafka-server proper

invoking kafka consumer as soon as message arrives in topic

Hi all Iam trying to write a web application which is invoked when the message arrives in topic. The code is waiting for a message in kafka consumer in while loop and sometimes it picks up the message and sometimes its waiting forever even when the message is produced in the topic. I am invoking

kafka 0.8 consumer polling topic

Hi all General question does the current kafka consumer needs to be written in java threads in order to poll the topic continuously and how should it be written any ideas please? Thanks Regards Surender Kudumula Big Data Consultant - EMEA Analytics & Data Management surender.kudum...@hpe.com

RE: Kafka - Rest api query

Tue, Oct 20, 2015 at 1:18 PM, Kudumula, Surender < surender.kudum...@hpe.com> wrote: > Thanks for the reply. Iam looking to know if its possible to route > binary objects messages to rest api service from kafka. If so please let me > know. > Otherwise I can consume the bi

RE: Kafka - Rest api query

.com] Sent: 20 October 2015 16:35 To: users@kafka.apache.org Subject: Re: Kafka - Rest api query Sounds like an app design decision. What help can this list give you ? > On 20-Oct-2015, at 8:07 PM, Kudumula, Surender > wrote: > > Dear sir/madam > I have a query. We are working o

Kafka - Rest api query

Dear sir/madam I have a query. We are working on POC at the moment and we are using kafka to produce and consume messages. I have one component which consumes the request from topic and processes it and creates a file and again produce the java object as byte array to another kafka topic. Now I