Content based enhancement for Apache Kafka

2016-10-09 Thread Janagan Sivagnanasundaram
Publisher/Subscriber systems can be divided into two categories. 1) Topic based model 2) Content based model - Provide accurate results compared to topic based model, since subscribers interested on the content of the message rather than subscribing to a topic and getting all the messages. Kafka i

Fwd: Content based enhancement for Apache Kafka

2016-10-10 Thread Janagan Sivagnanasundaram
Publisher/Subscriber systems can be divided into two categories. 1) Topic based model 2) Content based model - Provide accurate results compared to topic based model, since subscribers interested on the content of the message rather than subscribing to a topic and getting all the messages. Kafka i

Question regarding dynamic subscriber environment

2016-11-01 Thread Janagan Sivagnanasundaram
Kafka's current nature is does not support to dynamic subscriber environment where the topic interest of the subscriber is keep change overtime unless subscriber terminate the particular connection and reconnect. What I have planned to implement or design is to enable the dynamic subscriber enviro

Re: Question regarding dynamic subscriber environment

2016-11-02 Thread Janagan Sivagnanasundaram
rit...@gmail.com> wrote: > Hi, > > Have a look at the kafka client lib > https://github.com/gerritjvv/kafka-fast#java-1, it already provides this > functionality. > > > On Wed, Nov 2, 2016 at 2:34 AM, Janagan Sivagnanasundaram < > janagan1...@gmail.com> wrote: > >

Enabling Top-k extraction module to Kafka

2016-11-21 Thread Janagan Sivagnanasundaram
Hi, Is there any libraries or any other way to implement top-k quality extraction algorithm (top-k info per window/batch) to the existing Kafka, which enable the consumer to get the top-k quality information once the consumer subscribed to a particular topic. Scenario: Producer free to produce me

Question regarding enhancement for Apache Kafka

2016-05-18 Thread Janagan Sivagnanasundaram
Hello, I Janagan Sivagnanasundaram from Sri Lanka, and pursuing final year undergraduate studies under software engineering at University of Colombo School of Computing, Sri Lanka. As a part of the fulfillment of the degree we have to do a final year software engineering project with 3 members

Re: Question regarding enhancement for Apache Kafka

2016-05-19 Thread Janagan Sivagnanasundaram
There are two type of publisher-subscriber system, topic based publisher-subscriber system and content based publisher-subscriber system. Kafka is a topic based publisher-subscriber system. We wanted to enhance the kafka to support content based subscriptions.

Re: Question regarding enhancement for Apache Kafka

2016-05-19 Thread Janagan Sivagnanasundaram
content filtering rules into a Samza system. This will > > give you a "content subscription" system you intend to build. > > > > Get Outlook for iOS > > > > > > > > > > On Thu, May 19, 2016 at 1:56 AM -0700, "Janagan Sivagnanasunda