Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19464
Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82752/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82752 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82752/testReport)**
for PR 19464 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19464
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82752 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82752/testReport)**
for PR 19464 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82726/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82726 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82726/testReport)**
for PR 19464 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82726 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82726/testReport)**
for PR 19464 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82716/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82716 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82716/testReport)**
for PR 19464 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82716 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82716/testReport)**
for PR 19464 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82696/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82696 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82696/testReport)**
for PR 19464 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82694/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82694 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82694/testReport)**
for PR 19464 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82696 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82696/testReport)**
for PR 19464 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82694 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82694/testReport)**
for PR 19464 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19464
I can't think of any downside, but it's always safe to avoid behavior
changes. LGTM
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82672/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82672 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82672/testReport)**
for PR 19464 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82672 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82672/testReport)**
for PR 19464 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82658/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19464
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82658 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82658/testReport)**
for PR 19464 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19464
**[Test build #82658 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82658/testReport)**
for PR 19464 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19464
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19464
I think the optimisation by `spark.sql.files.maxPartitionBytes` sql
specific conf includes this concept in `FileScanRDD` and it looks already
partially doing it in combining input splits. I'd
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/19464
IIUC this issue also existed in `NewHadoopRDD` and `FileScanRDD`
(possibly), we'd better also fix them.
---
-
To unsubscribe,
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/19464
Interesting. On the one hand I don't like adding yet another flag that
changes behavior, when the user often can't meaningfully decide to set it.
There is probably no value in processing an empty
Github user liutang123 commented on the issue:
https://github.com/apache/spark/pull/19464
@kiszk Any other suggestions an can ti PR be merged?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
36 matches
Mail list logo