Re: Help needed regarding error with 5 node Spark cluster (shuffle error)- Comcast

Not sure where you get the property name "spark.memory.offHeap.use". The correct one should be "spark.memory.offHeap.enabled".  See https://spark.apache.org/docs/latest/configuration.html#spark-properties for details. On 1/30/23 10:12 AM, Jain, Sanchi wrote: I am not sure if this is the

Re: Help needed regarding error with 5 node Spark cluster (shuffle error)- Comcast

Hi, Identify the cause of the shuffle. Also how are you using HDFS here? https://community.cloudera.com/t5/Support-Questions/Spark-Metadata-Fetch-Failed-Exception-Missing-an-output/td-p/203771 HTH view my Linkedin profile

Help needed regarding error with 5 node Spark cluster (shuffle error)- Comcast

I am not sure if this is the intended DL for reaching out for help. Please redirect to the right DL From: Jain, Sanchi Date: Monday, January 30, 2023 at 10:10 AM To: priv...@spark.apache.org Subject: Request for access to create a jira account- Comcast Hello there I am a principal engineer at

Re: Re: spark+kafka+dynamic resource allocation

Sure, I suggest that you add a note to that Jira and express your interest. HTH view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any