Github user yhuai commented on the issue:
https://github.com/apache/spark/pull/13444
Thanks! Merging to master and branch 2.0.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
ena
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60335/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60335 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60335/consoleFull)**
for PR 13444 at commit
[`f392f91`](https://github.com/apache/spark/commit/
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/13444
@yhuai okay, fixed. I also fixed #13137 in the same way.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60335 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60335/consoleFull)**
for PR 13444 at commit
[`f392f91`](https://github.com/apache/spark/commit/f
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60112/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60112 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60112/consoleFull)**
for PR 13444 at commit
[`1978d95`](https://github.com/apache/spark/commit/
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/13444
@yhuai okay, plz check this again?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60105/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60105 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60105/consoleFull)**
for PR 13444 at commit
[`7c4a33f`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60109/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60109 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60109/consoleFull)**
for PR 13444 at commit
[`f2b997b`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60112 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60112/consoleFull)**
for PR 13444 at commit
[`1978d95`](https://github.com/apache/spark/commit/1
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/13444
btw, we can fix #13137 in a similar way, that is, we set `val
numParallelism = partialFileStatusInfo.size /
Math.max(sqlConf.parallelPartitionDiscoveryThreshold, 1) + 1`. Thought?
---
If your proj
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60109 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60109/consoleFull)**
for PR 13444 at commit
[`f2b997b`](https://github.com/apache/spark/commit/f
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60107/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60107 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60107/consoleFull)**
for PR 13444 at commit
[`7e488c9`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60107 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60107/consoleFull)**
for PR 13444 at commit
[`7e488c9`](https://github.com/apache/spark/commit/7
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60106/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60106 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60106/consoleFull)**
for PR 13444 at commit
[`395d9e4`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60106 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60106/consoleFull)**
for PR 13444 at commit
[`395d9e4`](https://github.com/apache/spark/commit/3
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60105 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60105/consoleFull)**
for PR 13444 at commit
[`7c4a33f`](https://github.com/apache/spark/commit/7
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/13444
I see. `val numParallelism = paths.size /
Math.max(sqlConf.parallelPartitionDiscoveryThreshold, 1)` is more meaningful
for both small and large clusters?
---
If your project is set up for it, you c
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/13444
@yhuai ping
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if th
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59823/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #59823 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59823/consoleFull)**
for PR 13444 at commit
[`283b55a`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #59823 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59823/consoleFull)**
for PR 13444 at commit
[`283b55a`](https://github.com/apache/spark/commit/2
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59744/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #59744 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59744/consoleFull)**
for PR 13444 at commit
[`9a14cd8`](https://github.com/apache/spark/commit/
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/13444
@yhuai I looked into the previous commit logs though, I'm also not sure why
the option has a "threshold" at the end. However, as you said, I also thinks we
can use this option to control #parallelism
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #59744 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59744/consoleFull)**
for PR 13444 at commit
[`9a14cd8`](https://github.com/apache/spark/commit/9
39 matches
Mail list logo
