Re: Kafka Consumer Hung on Certain Partitions - Single Kafka Consumer

Hi Kafka Users, I am desperate to find an answer to this issue. I would like to know whether my issue is due to a Single Kafka Consumer ? Where should I look for answers for this issue? Is it something do with the Kafka Broker ? I am using Kafka version 0.11.01 version for both Kafka broker an

[VOTE] 1.1.1 RC3

Hello Kafka users, developers and client-developers, This is the fourth candidate for release of Apache Kafka 1.1.1. Apache Kafka 1.1.1 is a bug-fix release for the 1.1 branch that was first released with 1.1.0 about 3 months ago. We have fixed about 25 issues since that release. A few of the

Re: [kafka-clients] [VOTE] 1.0.2 RC1

This vote passes with 6 +1 votes (3 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Ismael * Jun * Rajini Committers: * Harash * Matthias Community: * Manikumar 0 votes * No votes -1 votes * No votes Vote thread: http://search-hadoop.com/m/uyzND1jdiCf2ByEaI1=+VOTE+1+0+2+RC1 I'll

Re: [kafka-clients] [VOTE] 1.0.2 RC1

+1 -Matthias On 7/3/18 8:54 AM, Rajini Sivaram wrote: > Hi Matthias, > > +1 (binding) > > Thank you for running the release. > > Ran quick start with binary, tests with source, checked javadocs. > > Regards, > > Rajini > > On Mon, Jul 2, 2018 at 9:34 PM, Harsha >

Re: Real time streaming as a microservice

From: Mich Talebzadeh Sent: Sunday, July 8, 2018 1:01 PM To: users@kafka.apache.org Subject: Re: Real time streaming as a microservice Thanks Martin. >From an implementation point of view do we need to introduce docker for each microservice? In other words

Re: Real time streaming as a microservice

Thanks Martin. >From an implementation point of view do we need to introduce docker for each microservice? In other words does it have to be artefact --> contain --> docker for this to be true microservice and all these microservices communicate through Service Registry. Also if we wanted to

Why is kafka poll method blocking?

Writing to Kafka is non-blocking but reading from it blocks thread. Why does the Kafka poll method not use non-blocking API and then receive records in a callback?

Re: Real time streaming as a microservice

initial work under using Zookeeper as a Microservices container is here http://planet.jboss.org/post/zookeeper_for_microservice_registration_and_discovery ZooKeeper for Microservice Registration and Discovery

Re: Real time streaming as a microservice

Yes or Kafka will need it ... As soon as your orchestrate different microservices this will happen. > On 8. Jul 2018, at 11:33, Mich Talebzadeh wrote: > > Thanks Jorn. > > So I gather as you correctly suggested, microservices do provide value in > terms of modularisation. However, there will

Re: Real time streaming as a microservice

That they are loosely coupled does not mean they are independent. For instance, you would not be able to replace Kafka with zeromq in your scenario. Unfortunately also Kafka sometimes needs to introduce breaking changes and the dependent application needs to upgrade. You will not be able to

Real time streaming as a microservice

Hi, I have created the Kafka messaging architecture as a microservice that feeds both Spark streaming and Flink. Spark streaming uses micro-batches meaning "collect and process data" and flink as an event driven architecture (a stateful application that reacts to incoming events by triggering

Re: [External] Re: Cannot run the inbuild zookeeper server.

1) identify which process is using port 2191 *netstat -plten|grep 2181* tcp6 0 0 :::2181 :::* LISTEN 1005 47356 4226/java 2) Find out the details *ps -ef|grep 4226* hduser4226 1 0 Jul05 ?00:03:09 /usr/java/latest/bin/java

Re: [External] Re: Cannot run the inbuild zookeeper server.

Hello, It seems that some other application is running on 2181 port and i am unable to terminate it. So I decided to change the port for the zookeeper server and now its running fine. Thanks, *Vineet Apoorv Herenj* M.Tech, IIT Kharagpur Department of Computer Science and Engineering Kharagpur,