Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22867
Merging to master / 2.4.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22867
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98831/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22867
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22867
**[Test build #98831 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98831/testReport)**
for PR 22867 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22867
**[Test build #98831 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98831/testReport)**
for PR 22867 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22867
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gss2002 commented on the issue:
https://github.com/apache/spark/pull/22867
@vanzin can you review the latest PR. This seems like it works without
issue. I ran this on my home cluster and my larger clusters at work where the
issue was first discovered and it seems to solve
Github user gss2002 commented on the issue:
https://github.com/apache/spark/pull/22867
@vanzin you are right! I appreciate the help with this one. I will cut a
patch in the AM after testing on a large scale cluster job that is taking from
IBM MQ and ETLing data and shipping off to
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22867
I think the reason your original attempt didn't work is because of how you
wrote the code.
private val tmpDir = "file:///" + System.getProperty("java.io.tmpdir")
That seems to
Github user lresende commented on the issue:
https://github.com/apache/spark/pull/22867
@gss2002 Sorry I missed this initially, but great that @vanzin is helping
you with the fix.
---
-
To unsubscribe, e-mail:
Github user gss2002 commented on the issue:
https://github.com/apache/spark/pull/22867
@vanzin can you please review latest patch thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user gss2002 commented on the issue:
https://github.com/apache/spark/pull/22867
@vanzin this seems to work.. Not sure what your thoughts are on this
private val tmpDir = broadcastedHadoopConf.value.get("hadoop.tmp.dir",
System.getProperty("java.io.tmpdir"))
Github user gss2002 commented on the issue:
https://github.com/apache/spark/pull/22867
@vanzin I made the following change and it didn't work. How do you want to
proceed?
---
a/streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala
+++
Github user gss2002 commented on the issue:
https://github.com/apache/spark/pull/22867
@vanzin trying this.. I'll advise shortly
private val tmpDir = "file:///" + System.getProperty("java.io.tmpdir")
---
Github user gss2002 commented on the issue:
https://github.com/apache/spark/pull/22867
History from JIRA and error
WriteAheadLogBackedBlockRDD in YARN Cluster Mode Fails due lack of access
to HDFS path
due to it using a similar name was $PWD folder from YARN AM Cluster
Github user gss2002 commented on the issue:
https://github.com/apache/spark/pull/22867
@lresende any possibilities of getting this change committed or at least
getting it on the radar for key changes for spark to work with YARN Cluster
mode specifically since $PWD creates issues with
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22867
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22867
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22867
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
19 matches
Mail list logo
