Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22615
also, i will be deleting the following jobs:
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test/job/spark-master-test-sbt-hadoop-2.6/
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22615
ok just to revisit this: i'm going to push out the new jenkins jobs
configs now, and not gate on moving these to the spark repo.
---
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22615
Merged to master. Note that the master hadoop 2.6 job will fail immediately
now, so ignore it. On the upside ... this job already wont' take much of any
time from the Jenkins cluster.
---
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22615
i haven't had a chance to do any of the jenkins stuff... after being
sidetracked by the conversation to move the configs to the spark repo, plus
planning for our big event that starts tomorrow,
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22615
Fine with me if the jenkins stuff is sorted out.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22615
I tried a release build that causes `--pip` and `--r` to be set, and the
result looked OK. Both pyspark and R packages built and seemed normal. The
source build worked too and comes before binary
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22615
>
>
> I want to see the configurations ..
>
>
> they're just some absolutely breath-taking bits of yaml to define all of
the spark jenkins jobs.
aka: really
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22615
@felixcheung regarding building PIP and R in one release, yeah I was
wondering that too. Ideally it would just be one. If the build changes only
affect the source release, that's OK, as this is
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/22615
I think we all know enough to not to make changes (merge changes) to these
config, should be safe.
---
-
To unsubscribe,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97137/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #97137 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97137/testReport)**
for PR 22615 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22615
I want to see the configurations ..
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22615
@srowen fair 'nuf... i'll create a jira for this tomorrow and we can hash
out final design shite there (rather than overloading this PR). :)
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #97137 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97137/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22615
Yeah this does need to be in a public repo.
apache/spark-jenkins-configurations or something. We can ask INFRA to create
them. But, I'm not against just putting them in dev/ or something in the main
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22615
@vanzin i'm not opposed to hosting these configs somewhere else.
@JoshRosen did this a few years back just to "get shit done"...
i'd be leery of putting this in to the main spark repo,
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22615
Hmmm... just want to raise a possible issue that maybe, just maybe, we
should be hosting those jenkins configs in a repository that is owned by the
ASF and writable by all Spark committers.
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22615
https://github.com/databricks/spark-jenkins-configurations/pull/47
---
-
To unsubscribe, e-mail:
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22615
@srowen sure, manually removing the failing jobs is one option... but
since we auto-generate the job configs, any time we add a new branch they'll
come back.
i'd much rather do this
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22615
> an unset var is just an empty string anyway.
The issue is that if you call that function multiple times the variables
might be set by a previous call.
---
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22615
consider me pinged. ;)
i will need to do some refactoring in the jenkins job builder configs for
this, so we'll definitely need to coordinate before this is merged.
most likely
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22615
I guess we've just pinged @shaneknapp ! But I figured the jobs would simply
fail and could be removed at leisure.
Yes, this mechanism is a little weird but may be the simplest thing here. I
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97116/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #97116 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97116/testReport)**
for PR 22615 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #97116 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97116/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97105/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #97105 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97105/testReport)**
for PR 22615 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #97105 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97105/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97054/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #97054 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97054/testReport)**
for PR 22615 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #97054 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97054/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22615
> had classpath-like references to hadoop-...-2.6.5
It also has references to a bunch of other old stuff; I don't think there's
a need to change it.
---
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22615
That app-... file had classpath-like references to hadoop-...-2.6.5 jars.
It may not matter but I updated them. That should be the only difference
---
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22615
What is the change in `app-20180109111548-` about? It's hard to see in
the diff and I'm a little surprised you needed to touch it.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96961/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96961 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96961/testReport)**
for PR 22615 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96961 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96961/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96942/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96942 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96942/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96942 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96942/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96930/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96930 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96930/testReport)**
for PR 22615 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96930 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96930/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96894/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96894 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96894/testReport)**
for PR 22615 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96894 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96894/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22615
Yep, already updated in the first commit actually. I'm not sure if that's
why appveyor failed here. Let's see on another test.
---
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22615
We can simplery this:
https://github.com/apache/spark/blob/7ad18ee9f26e75dbe038c6034700f9cd4c0e2baa/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala#L273-L295
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96867/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96867 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96867/testReport)**
for PR 22615 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22615
**[Test build #96867 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96867/testReport)**
for PR 22615 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22615
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
76 matches
Mail list logo
