I'm streamin data from kafka topic using kafkautils doing some
computation and writing records to hbase.
Storage level is memory-and-disk-ser
On 27 Feb 2015 16:20, Akhil Das ak...@sigmoidanalytics.com wrote:
You could be hitting this issue
https://issues.apache.org/jira/browse/SPARK-4516
Also my job is map only so there is no shuffle/reduce phase.
On Fri, Feb 27, 2015 at 7:10 PM, Mukesh Jha me.mukesh@gmail.com wrote:
I'm streamin data from kafka topic using kafkautils doing some
computation and writing records to hbase.
Storage level is memory-and-disk-ser
On 27 Feb
You could be hitting this issue
https://issues.apache.org/jira/browse/SPARK-4516
Apart from that little more information about your job would be helpful.
Thanks
Best Regards
On Wed, Feb 25, 2015 at 11:34 AM, Mukesh Jha me.mukesh@gmail.com
wrote:
Hi Experts,
My Spark Job is failing with
I don't have an idea, but perhaps a little more context would be helpful.
What is the source of your streaming data? What's the storage level you're
using?
What are you doing? Some kind of windows operations?
Regards,
Jeff
2015-02-26 18:59 GMT+01:00 Mukesh Jha me.mukesh@gmail.com:
On
On Wed, Feb 25, 2015 at 8:09 PM, Mukesh Jha me.mukesh@gmail.com wrote:
My application runs fine for ~3/4 hours and then hits this issue.
On Wed, Feb 25, 2015 at 11:34 AM, Mukesh Jha me.mukesh@gmail.com
wrote:
Hi Experts,
My Spark Job is failing with below error.
From the logs I
My application runs fine for ~3/4 hours and then hits this issue.
On Wed, Feb 25, 2015 at 11:34 AM, Mukesh Jha me.mukesh@gmail.com
wrote:
Hi Experts,
My Spark Job is failing with below error.
From the logs I can see that input-3-1424842351600 was added at 5:32:32
and was never purged
Hi Experts,
My Spark Job is failing with below error.
From the logs I can see that input-3-1424842351600 was added at 5:32:32 and
was never purged out of memory. Also the available free memory for the
executor is *2.1G*.
Please help me figure out why executors cannot fetch this input.
Txz for
