-- Forwarded message --
From: "pravin kumar"
Date: 27-Mar-2018 6:11 PM
Subject: Consumer slowness issue
To:
Cc:
i have two topics with 5 partitions each
wikifeedInputT10
KafkaProducer produces 10 elements and wikifeedInputT10 have
received these elements.
[adm
mStreams::close));*/
}
public static void ProducerInput(){
String[] users={"pravin","kumar","erica", "bob", "joe", "damian", "tania", "phil", "sam",
uot;;
final static String CONSUMER_WIKIFEED_LAMBDA="ConsumerWikiFeedLambda1";
public static void main(String[] args) {
ProducerInput();
ConsumerOutput();
}
public static void ProducerInput(){
String[] users={"pravin","kumar&q
I have run wikifeed example. i have three topics:
wikifeedInputtopicDemo2-10 partitions
wikifeedOutputtopicDemo2-10 partitions
sumoutputeventopicDemo2-5 partitions
i have produced 10 records.but in the
inputTopic(wikifeedInputtopicDemo2) it receives more than 10
records.
can someone explai
tic String CONSUMER_WIKIFEED_LAMBDA="ConsumerWikiFeedLambda1";
public static void main(String[] args) {
ProducerInput();
ConsumerOutput();
}
public static void ProducerInput(){
String[] users={"pravin","kumar","erica&qu
Can we give the ouput of one processorTopology as the input to another
processorTopology.
if it is possible,how can we do it.
Can anyone provide it with any example
i have tried wikifeed example with Kafka 2_12.1.0.0.the count method is now
depricated ,
previously in kafka_2.11-0.10.2.1 i have given count(localStateStoreName).
how to give the statestore name in Kafka 2_12.1.0.0.
i have attached the code below,
package kafka.examples.wikifeed;
import org.ap
(ConsumerConfig.CLIENT_ID_CONFIG,"C1");
//properties.put(ConsumerConfig.CLIENT_ID_CONFIG,"C2");
properties.put(ConsumerConfig.CLIENT_ID_CONFIG,"C3");
return properties;
}
public static void produceInput(){
Random random=new Random();
I have studied KafkaStreams, but not clearly understood
1.Can someone explain about Fault tolerence.
2.I have topicA and topicB with 4 partitions, so it created fourTasks, I
have created it in singleJVM.But i need to knw how it works in multiple JVM
and if one jvm goes down,how it another jvm take
i have created 3 inputtopics with 10 partitions each and output Topic with
10 partitions
I did wordcount example and stored it in GlobalKTable.
i initally stored counted value in LocalStateStore and then it to
GlobalStateStore.
i have atteated the code here:
https://gist.github.com/Pk007790/d46
i have created 3 topics with 10 partitions each
i have intended to store processed information in globalKtable
now i have did with individual Ktable to Output topic then to GlobalKtable
#//
KStreamBuilder builder=new KStreamBuilder();
KStream inputStream =
builder.stream(INPUT_TOPICA,INPUT_TOPI
from the
> repartitioning.
>
> On Tue, 31 Oct 2017 at 10:56 pravin kumar wrote:
>
> > I have created a stream with topic contains 5 partitions and expected to
> > create 5 stream tasks ,i got 10 tasks as
> > 0_0 0_1 0_2 0_3 0_4 1_0 1_1 1_2 1_3 1_4
> &g
t; which would cause the extra tasks.
> If you provide the topology we would be able to tell you.
> Thanks,
> Damian
>
> On Tue, 24 Oct 2017 at 10:14 pravin kumar wrote:
>
> > I have created a stream with topic contains 5 partitions and expected to
> > create 5 stream tas
I have created a stream with topic contains 5 partitions and expected to
create 5 stream tasks ,i got 10 tasks as
0_0 0_1 0_2 0_3 0_4 1_0 1_1 1_2 1_3 1_4
my doubt is:im expected to have 5 tasks how it produced 10 tasks
here are some logs:
[2017-10-24 10:27:35,284] INFO Kafka
I have created a stream with topic contains 5 partitions and expected to
create 5 stream tasks ,i got
[admin@nms-181 ]$ ls
0_0 0_1 0_2 0_3 0_4 1_0 1_1 1_2 1_3 1_4
SingleConsumerMultiConsumerUsingStreamx4 is my application_id and this
1_0,1_... contains localStateStore
and 0_0,0_ cont
irst bootstrap server, -2
> for the second and so on.
>
>
>
> ------ Forwarded message --
> From: pravin kumar
> To: users@kafka.apache.org
> Cc:
> Bcc:
> Date: Fri, 20 Oct 2017 14:44:04 +0530
> Subject: reg Kafka Node num
> I have run a Multiple Pa
I have run a Multiple Partition and Multiple Consumer application.Then i
have altered the no of Partitions,
in log im getting
Using older server API v0 to send HEARTBEAT
{group_id=
altermultipartitionmulticonsumer2,group_generation_id=6,
member_id=C2-b7b4f485-d0c3-466b-b0e7-b3de834832e9} to node
I have run a Multiple Partition and Multiple Consumer application.Then i
have altered the no of Partitions,
in log im getting
Using older server API v0 to send HEARTBEAT {group_id=
altermultipartitionmulticonsumer2,group_generation_id=6,
member_id=C2-b7b4f485-d0c3-466b-b0e7-b3de834832e9} to node
18 matches
Mail list logo
