Re: How to use HDP kafka?

before used HDP? I searched a solution that > is http://www.cnblogs.com/i2u9/p/ambari-kafka-multiip.html, but it not > works for me. > > Attachment errorInfo and HDPConfig snapshot. > > Thanks in advance! > > Thanks， > Nicole > > > On Wed, Jun 1, 2016 at 8:44 PM,

Re: How to use HDP kafka?

Hi, I am unable to see the images. But I use Kafka with HDP right now without any problem. On Tue, May 31, 2016 at 9:33 PM, Shaolu Xu wrote: > Hi All, > > > Anyone used HDP to run kafka, I used it and face a problem.The following > is the error info: > > [image: Inline

Re: Use Zookeeper for a Producer

active > broker. > > Alex > > On Tue, May 31, 2016 at 12:44 PM, Igor Kravzov <igork.ine...@gmail.com> > wrote: > > > What if number of brokers change? Does it mean I need to change > > configuration or potentially recompile my producer and consumer? >

Re: Use Zookeeper for a Producer

roduced in 0.9, > doesn't use ZooKeeper. The producer doesn't use ZooKeeper, either. However, > brokers still use ZooKeeper. > > Alex > > On Tue, May 31, 2016 at 12:03 PM, Igor Kravzov <igork.ine...@gmail.com> > wrote: > > > When I look at code samples pr

Re: Topics, partitions and keys

Thanks Alex. On Tue, May 31, 2016 at 2:37 PM, Alex Loddengaard <a...@confluent.io> wrote: > Hi Igor, see inline: > > On Sat, May 28, 2016 at 8:14 AM, Igor Kravzov <igork.ine...@gmail.com> > wrote: > > > I need some clarification on subject. > > In Kaf

Use Zookeeper for a Producer

When I look at code samples producers mostly write to brokers and consumers use Zookeeper to consume from topics. Using Microsoft .net client ( https://github.com/Microsoft/CSharpClient-for-Kafka) I wrote producer witch uses Zookeeper and was able to write data successfully. Am I missing

10MB message

In our system some data can be as big as 10MB. Is it OK to send 10 MB message through Kafka? What configuration parameters should I check/set? It is going to be one topic with one consumer - Apache NiFi GetKafka processor. Is one partition enough?

Re: Topics, partitions and keys

Thank you Todd for great response. On Sun, May 29, 2016 at 8:52 PM, Todd Palino <tpal...@gmail.com> wrote: > Answers are in-line below. > > -Todd > > On Sun, May 29, 2016 at 3:00 PM, Igor Kravzov <igork.ine...@gmail.com> > wrote: > > > Please help me with t

Topics, partitions and keys

Please help me with the subject. In Kafka documentations I found the following: *Kafka only provides a total order over messages within a partition, not between different partitions in a topic. Per-partition ordering combined with the ability to partition data by key is sufficient for most

Re: Test

thanks :) On Sun, May 29, 2016 at 2:09 PM, Stephen Powis <spo...@salesforce.com> wrote: > Hello! > > On Sun, May 29, 2016 at 1:02 PM, Igor Kravzov <igork.ine...@gmail.com> > wrote: > > > Please someone reply. Not sure if subscribed properly. > > >

Test

Please someone reply. Not sure if subscribed properly.

Topics, partitions and keys

I need some clarification on subject. In Kafka documentations I found the following: Kafka only provides a total order over messages *within* a partition, not between different partitions in a topic. Per-partition ordering combined with the ability to partition data by key is sufficient for most

Failed to find leader for Set exception

Hi, I am using Apache NiFi to read data form Kafka which runs as part of Hortonworks HDP 2.4. I use GetKafka processor to read messages form a topic but see the exception bellow. What can be wrong? 2016-05-26 17:13:36,776 INFO