Github user squito commented on the issue:
https://github.com/apache/spark/pull/21185
I'm closing this in favor of https://github.com/apache/spark/pull/21190
---
-
To unsubscribe, e-mail:
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21185
@jkbradley still seeing flakiness in R tests, in other PRs too. I'm not
even sure how to interpret the failure. is it safe to ignore those? I can't
see how this would be effecting R tests ...
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21185
**[Test build #4169 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4169/testReport)**
for PR 21185 at commit
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21185
> Yea I think this is the root cause. I'm making a PR to ban SQLConf.get at
executor side, shall we do the same thing for SparkSession? And fixes all the
places that mistakenly access SparkSession
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21185
**[Test build #4169 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4169/testReport)**
for PR 21185 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21185
> that's the whole problem. Its only meant to be available on the driver,
but it ends up getting set on the executor when running in local mode.
Yea I think this is the root cause. I'm
Github user jkbradley commented on the issue:
https://github.com/apache/spark/pull/21185
There have been several of these R tests. May be from flakiness with CRAN;
testing locally now (since I didn't see any recent bad commits in R).
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21185
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89978/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21185
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21185
**[Test build #89978 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89978/testReport)**
for PR 21185 at commit
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21185
I don't understand the comments about "leaked threads". the executor
thread pool is allowed to create threads whenever it wants. You can play
around with this example if you like:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21185
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21185
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2752/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21185
**[Test build #89978 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89978/testReport)**
for PR 21185 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21185
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21185
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/21185
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21185
LGTM pending Jenkins
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21185
**[Test build #4161 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4161/testReport)**
for PR 21185 at commit
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21185
Jenkins, retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ericl commented on the issue:
https://github.com/apache/spark/pull/21185
This makes sense to me. It would be slightly to clear it where where the
session is getting leaked through threads, but if that's hard then this looks
good.
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21185
cc @ericl too
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21185
**[Test build #4160 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4160/testReport)**
for PR 21185 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21185
**[Test build #4160 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4160/testReport)**
for PR 21185 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21185
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21185
Tests haven't triggered, weird. LGTM pending tests.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21185
@cloud-fan
> I think SparkSession is driver only, how do we access it in executor?
that's the whole problem. Its only meant to be available on the driver,
but it ends up getting set on
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21185
I think `SparkSession` is driver only, how do we access it in executor?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21185
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21185
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89939/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21185
**[Test build #89939 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89939/testReport)**
for PR 21185 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21185
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21185
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2728/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21185
**[Test build #89939 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89939/testReport)**
for PR 21185 at commit
34 matches
Mail list logo
