...@sigmoidanalytics.com]
Sent: Tuesday, June 16, 2015 12:44 PM
To: Chaudhary, Umesh
Cc: user@spark.apache.org
Subject: Re: Optimizing Streaming from Websphere MQ
Each receiver will run on 1 core. So if your network is not the bottleneck then
to test the consumption speed of the receivers you can
: Optimizing Streaming from Websphere MQ
How many cores are you allocating for your job? And how many receivers are
you having? It would be good if you can post your custom receiver code, it
will help people to understand it better and shed some light.
Thanks
Best Regards
On Fri, Jun 12
not
experiencing any performance benefit from it.
Is it something related to the bottleneck of MQ or Reliable Receiver?
From: Akhil Das [mailto:ak...@sigmoidanalytics.com]
Sent: Saturday, June 13, 2015 1:10 AM
To: Chaudhary, Umesh
Cc: user@spark.apache.org
Subject: Re: Optimizing Streaming from Websphere MQ
Hi,
I have created a Custom Receiver in Java which receives data from Websphere MQ
and I am only writing the received records on HDFS.
I have referred many forums for optimizing speed of spark streaming
application. Here I am listing a few:
* Spark
How many cores are you allocating for your job? And how many receivers are
you having? It would be good if you can post your custom receiver code, it
will help people to understand it better and shed some light.
Thanks
Best Regards
On Fri, Jun 12, 2015 at 12:58 PM, Chaudhary, Umesh
