nathan (WT01 - NEP) <vivek.meghanat...@wipro.com>;
duc.was.h...@gmail.com; user@spark.apache.org
Subject: Re: Spark Streaming + Kafka + scala job message read issue
Hi Bryan,
Yes we are using only 1 thread per topic as we have only one Kafka server with
1 partition.
What kind of logs will tell us
Meghanathan (WT01 - NEP)
Sent: 27 December 2015 11:08
To: Bryan <bryan.jeff...@gmail.com>
Cc: Vivek Meghanathan (WT01 - NEP) <vivek.meghanat...@wipro.com>;
duc.was.h...@gmail.com; user@spark.apache.org
Subject: Re: Spark Streaming + Kafka + scala job message read issue
Hi Bryan,
Yes
...@gmail.com
Cc: duc.was.h...@gmail.com; vivek.meghanat...@wipro.com; user@spark.apache.org
Subject: Re: Spark Streaming + Kafka + scala job message read issue
Hi Brian,PhuDuc,
All 8 jobs are consuming 8 different IN topics. 8 different Scala jobs running
each topic map mentioned below has only 1 thread
l.com>
Cc: duc.was.h...@gmail.com<mailto:duc.was.h...@gmail.com>;
vivek.meghanat...@wipro.com<mailto:vivek.meghanat...@wipro.com>;
user@spark.apache.org<mailto:user@spark.apache.org>
Subject: Re: Spark Streaming + Kafka + scala job message read issue
Hi Brian,PhuDuc,
All 8
Any help is highly appreciated, i am completely stuck here..
From: Vivek Meghanathan (WT01 - NEP)
Sent: Thursday, December 24, 2015 7:50 PM
To: Bryan; user@spark.apache.org
Subject: RE: Spark Streaming + Kafka + scala job message read issue
We are using
t; for
Windows 10 phone
From: PhuDuc Nguyen<mailto:duc.was.h...@gmail.com>
Sent: Friday, December 25, 2015 3:35 PM
To: vivek.meghanat...@wipro.com<mailto:vivek.meghanat...@wipro.com>
Cc: user@spark.apache.org<mailto:user@spark.apache.org>
Subject: Re: Spark Streaming + Kafka +
...@wipro.com
Sent: Friday, December 25, 2015 2:18 PM
To: bryan.jeff...@gmail.com; user@spark.apache.org
Subject: Re: Spark Streaming + Kafka + scala job message read issue
Any help is highly appreciated, i am completely stuck here..
From: Vivek Meghanathan (WT01 - NEP)
Sent: Thursday, December 24
gt; parse(line._2).extract[Search])
>
>
>
>
>
> Regards,
> Vivek M
>
> *From:* Bryan [mailto:bryan.jeff...@gmail.com]
> *Sent:* 24 December 2015 17:20
> *To:* Vivek Meghanathan (WT01 - NEP) <vivek.meghanat...@wipro.com>;
> user@spark.apache.org
> *Subjec
Agreed. I did not see that they were using the same group name.
Sent from Outlook Mail for Windows 10 phone
From: PhuDuc Nguyen
Sent: Friday, December 25, 2015 3:35 PM
To: vivek.meghanat...@wipro.com
Cc: user@spark.apache.org
Subject: Re: Spark Streaming + Kafka + scala job message read issue
Are you using a direct stream consumer, or the older receiver based consumer?
If the latter, do the number of partitions you’ve specified for your topic
match the number of partitions in the topic on Kafka?
That would be an possible cause – as you might receive all data from a given
partition
anathan (WT01 - NEP) <vivek.meghanat...@wipro.com>;
user@spark.apache.org
Subject: RE: Spark Streaming + Kafka + scala job message read issue
Are you using a direct stream consumer, or the older receiver based consumer?
If the latter, do the number of partitions you’ve specified fo
11 matches
Mail list logo
