[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-12-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/23130 We don't need to block it, but @MaxGekk if you have time, it would great to answer https://github.com/apache/spark/pull/23130#issuecomment-442491582 thanks, merging to master! ---

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99465/ Test PASSed. ---

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23130 **[Test build #99465 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99465/testReport)** for PR 23130 at commit

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23130 **[Test build #99465 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99465/testReport)** for PR 23130 at commit

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-28 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/23130 I think this change makes sense, at least it's good for performance. My only concern is, shall we ask all the parsers to return Nil for empty files? AFAIK JSON doesn't follow it. ---

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99335/ Test PASSed. ---

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23130 **[Test build #99335 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99335/testReport)** for PR 23130 at commit

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23130 **[Test build #99335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99335/testReport)** for PR 23130 at commit

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/23130 The code change LGTM. There is a mistake in PR description: we updated `FileSourceScanExec` not `DataSourceScanExec`. Let's also mention that this fixed a behavior change introduced by

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99239/ Test PASSed. ---

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23130 **[Test build #99239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99239/testReport)** for PR 23130 at commit

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23130 **[Test build #99239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99239/testReport)** for PR 23130 at commit

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99227/ Test PASSed. ---

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23130 **[Test build #99227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99227/testReport)** for PR 23130 at commit

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-24 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/23130 @cloud-fan @HyukjinKwon Please, take a look at the PR. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23130 **[Test build #99227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99227/testReport)** for PR 23130 at commit

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23130: [SPARK-26161][SQL] Ignore empty files in load

2018-11-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23130 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional