RE: Optimizing Streaming from Websphere MQ

...@sigmoidanalytics.com] Sent: Tuesday, June 16, 2015 12:44 PM To: Chaudhary, Umesh Cc: user@spark.apache.org Subject: Re: Optimizing Streaming from Websphere MQ Each receiver will run on 1 core. So if your network is not the bottleneck then to test the consumption speed of the receivers you can

Re: Optimizing Streaming from Websphere MQ

1:10 AM > *To:* Chaudhary, Umesh > *Cc:* user@spark.apache.org > *Subject:* Re: Optimizing Streaming from Websphere MQ > > > > How many cores are you allocating for your job? And how many receivers are > you having? It would be good if you can post your custom receiver

RE: Optimizing Streaming from Websphere MQ

experiencing any performance benefit from it. Is it something related to the bottleneck of MQ or Reliable Receiver? From: Akhil Das [mailto:ak...@sigmoidanalytics.com] Sent: Saturday, June 13, 2015 1:10 AM To: Chaudhary, Umesh Cc: user@spark.apache.org Subject: Re: Optimizing Streaming from Websphere MQ

Re: Optimizing Streaming from Websphere MQ

How many cores are you allocating for your job? And how many receivers are you having? It would be good if you can post your custom receiver code, it will help people to understand it better and shed some light. Thanks Best Regards On Fri, Jun 12, 2015 at 12:58 PM, Chaudhary, Umesh < umesh.chaudh

Optimizing Streaming from Websphere MQ

Hi, I have created a Custom Receiver in Java which receives data from Websphere MQ and I am only writing the received records on HDFS. I have referred many forums for optimizing speed of spark streaming application. Here I am listing a few: * Spark Official