Kafka Streams - preview version - Exception in thread "StreamThread-1"

2016-04-19 Thread Ramanan, Buvana (Nokia - US)
Hello, I went thru QuickStart instructions at: http://docs.confluent.io/2.1.0-alpha1/streams/quickstart.html Downloaded confluent-2.1.0-alpha1, started ZK & kafka servers. Continuously producing to topic : streams-file-input. However, running the WordCountJob example throws error (pasting the me

Kafka Sreams Python API

2016-04-21 Thread Ramanan, Buvana (Nokia - US)
I am looking for python support for Kafka Streams. Can you comment if any team is working on that? Data Powers of kafka-python development team says they don't plan to do that as part of their project: https://github.com/dpkp/kafka-python/issues/652 So, any other team embarking on python APIs f

kafka-console-consumer using which API?

2016-04-25 Thread Ramanan, Buvana (Nokia - US)
Does kafka-console-consumer.sh utilize New Consumer API or Old Consumer API?

Invalid TimeStamp Error while running WordCountDemo - kafka-0.10.0

2016-04-27 Thread Ramanan, Buvana (Nokia - US)
Hello, I am trying to execute WordCountDemo app. I produced text to the input topic. But when I execute the WordCountDemo, I get error. please help resolve the following: ERROR Streams application error during processing in thread [StreamThread-1]: (org.apache.kafka.streams.processor.internals

RE: Invalid TimeStamp Error while running WordCountDemo - kafka-0.10.0

2016-04-29 Thread Ramanan, Buvana (Nokia - US)
while running WordCountDemo - kafka-0.10.0 Hello Buvana, Could you show me the command line you used to produce the text to Kafka as input? Also which version of Kafka are you using for the broker? Guozhang On Wed, Apr 27, 2016 at 12:07 PM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia.

RE: Invalid TimeStamp Error while running WordCountDemo - kafka-0.10.0

2016-05-02 Thread Ramanan, Buvana (Nokia - US)
timestamp as current system time in milliseconds. Guozhang On Fri, Apr 29, 2016 at 10:34 AM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia.com> wrote: > Hello Guozhang, > > thanks a lot for your response (to this and all of my previous questions). > Here is how I produce to the

RE: Invalid TimeStamp Error while running WordCountDemo - kafka-0.10.0

2016-05-03 Thread Ramanan, Buvana (Nokia - US)
lock time. And I cannot reproduce this issue from trunk either. Did you ran the console producer that is built from the trunk April 22nd as well? Guozhang On Mon, May 2, 2016 at 12:39 PM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia.com> wrote: > Guozhang, > > That worked!

RE: Invalid TimeStamp Error while running WordCountDemo - kafka-0.10.0

2016-05-09 Thread Ramanan, Buvana (Nokia - US)
from tech-preview console producer) without the one-line fix, you still see the issue? Guozhang On Tue, May 3, 2016 at 7:10 AM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia.com> wrote: > Guozhang, > > For bug scenario, I initially I produced to the topic using console

ERROR Processor got uncaught exception. (kafka.network.Processor)

2016-05-09 Thread Ramanan, Buvana (Nokia - US)
Hello, We are trying to understand the following error in one of the brokers in our cluster. It's a 3 broker cluster (all 3 servers are identical - Intel Xeon E5-2670 @2.6GHz, 8cores, 16 threads 64 GB RAM & 1 TB Disk), serving about 8000 topics, single partitioned & replication factor = 3. Ea

RE: ERROR Processor got uncaught exception. (kafka.network.Processor)

2016-05-10 Thread Ramanan, Buvana (Nokia - US)
that ip happened. Ismael On Tue, May 10, 2016 at 12:14 AM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia.com> wrote: > Hello, > > We are trying to understand the following error in one of the brokers in > our cluster. It's a 3 broker cluster (all 3 servers are ident

RE: ERROR Processor got uncaught exception. (kafka.network.Processor)

2016-05-10 Thread Ramanan, Buvana (Nokia - US)
at 2:45 PM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia.com> wrote: > Ismael, > > Version 0.9.0.1 > > Do you have any idea how to prevent this from happening? Is it a Kafka > issue? > > -Buvana > > -Original Message- > From: isma...@gmail.com

RE: ERROR Processor got uncaught exception. (kafka.network.Processor)

2016-05-10 Thread Ramanan, Buvana (Nokia - US)
reproduce it in a test cluster? If the latter, would you be able to test the latest 0.10.0.0 release candidate? We fixed a few issues in the SocketServer. Ismael On Tue, May 10, 2016 at 8:27 PM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia.com> wrote: > Ismael, > > Creat

download - 0.10.0.0 RC6

2016-05-18 Thread Ramanan, Buvana (Nokia - US)
Hello, A naïve question. How do I download 0.10.0 RC6 (or RC5) version? I clicked on "Download zip" under 0.10.0 trunk @ github, downloaded kafka-0.10.0.zip today, compiled & started the server. Mbeans shows the version to be 0.10.0-SNAPSHOT and am not sure where / how to download RC6. Please

RE: [COMMERCIAL] Re: download - 0.10.0.0 RC6

2016-05-18 Thread Ramanan, Buvana (Nokia - US)
; * Release artifacts to be voted upon (source and binary): > http://home.apache.org/~gwenshap/0.10.0.0-rc6/ Regards Ian. --- Ian Wrigley Director, Education Services Confluent, Inc Cell: (323) 819-4075 > On May 18, 2016, at 1:04 PM, Ramanan, Buvana (Nokia - US) > wrote: > > Hello, >

RE: [COMMERCIAL] Re: [COMMERCIAL] Re: download - 0.10.0.0 RC6

2016-05-18 Thread Ramanan, Buvana (Nokia - US)
nan, Buvana (Nokia - US) > wrote: > > Ian, > > Thanks a lot for the prompt response. > > What is the difference between the following? > > 1) kafka-0.10.0.0-src.tgz > 2) kafka_2.10-0.10.0.0.tgz > 3) kafka_2.11-0.10.0.0.tgz > > I suppose the 1st one is

RE: Kafka Sreams Python API

2016-06-16 Thread Ramanan, Buvana (Nokia - US)
indeed planning to add python APIs to Kafka Streams, the concrete ETA is not yet planned out. Guozhang On Thu, Apr 21, 2016 at 10:12 AM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia.com> wrote: > I am looking for python support for Kafka Streams. Can you comment if > any team i

specifying exact number of records to fetch

2016-09-23 Thread Ramanan, Buvana (Nokia - US)
Hello, Do Kafka protocol & KafkaConsumer (java) client address the following need? The caller specifies that it needs N number of records with a max wait time of Tn milliseconds. If N records are available within Tn, the records are returned to the caller. If Tn expires, then the caller gets w

RE: specifying exact number of records to fetch

2016-09-23 Thread Ramanan, Buvana (Nokia - US)
: specifying exact number of records to fetch "max.poll.records" config property can be used to limit the number of records returned in each consumer poll() method call. On Fri, Sep 23, 2016 at 10:49 PM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia-bell-labs.com> wrote: >

Replica selection at the time of topic creation

2017-04-06 Thread Ramanan, Buvana (Nokia - US/Murray Hill)
Hello, I tried to understand the algorithm used in choosing a leader of a topic / partition at the time of creation - rack unaware mode. I went thru TopicCommand.scala and AdminUtils.scala, especially assignReplicasToBrokersRackUnaware() function (pasted below for convenience) and figured that

Does Kafka elect new follower when the original follower is down?

2017-04-07 Thread Ramanan, Buvana (Nokia - US/Murray Hill)
Hello, I have a 6 broker cluster, configured with auto.leader.rebalance.enable=false. The broker ids are 1 thru 6. I have about 160 partitions for which I assigned the replicas to be 1,2,3 (1 is the leader). When broker-2 underwent a controlled shutdown, the 'kafka-topics.sh -describe' command