Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/16695
It's kind of a side-effect of how we deploy client configurations, I think.
We've had some issues with the topology scripts not being available together
with Spark client configs in certain
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/16695
So I'm just curious, in the specific case you saw this issue, what were the
configs? The configs on NM had the correct path or the ones on the gateways
were only pointing to gateway. If any
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/16695
> then overlay the user's config on top of it
Just tried this for kicks and doing it the naive way (with `addResource`)
would result in a bunch of warnings:
WARN
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/16695
Actually this can be considered kind of a continuation of SPARK-2669.
The issue this is trying to solve is that the NMs don't necessarily have a
client Hadoop configuration in place. (Or
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/16695
this seems really really specific to the scripts being in the hadoop conf
directory and the user using default mapping. I assume the hadoop confs on the
nodemanagers have a different config then
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/16695
@tgravescs
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16695
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71962/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16695
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16695
**[Test build #71962 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71962/testReport)**
for PR 16695 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16695
**[Test build #71962 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71962/testReport)**
for PR 16695 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16695
**[Test build #71961 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71961/testReport)**
for PR 16695 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16695
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16695
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71961/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16695
**[Test build #71961 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71961/testReport)**
for PR 16695 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16695
**[Test build #71953 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71953/testReport)**
for PR 16695 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16695
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71953/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16695
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16695
**[Test build #71953 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71953/testReport)**
for PR 16695 at commit
18 matches
Mail list logo
