GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/22972
[SPARK-25971][SQL] Ignore partition byte-size statistics in
SQLQueryTestSuite
## What changes were proposed in this pull request?
Currently, `SQLQueryTestSuite` is sensitive in terms of the bytes of
parquet files in table partitions. If we change the default file format (from
Parquet to ORC) or update the metadata of them, the test case should be changed
accordingly. This PR aims to make `SQLQueryTestSuite` more robust by ignoring
the partition byte statistics.
```
-Partition Statistics 1144 bytes, 2 rows
+Partition Statistics [not included in comparison] bytes, 2 rows
```
## How was this patch tested?
Pass the Jenkins with the newly updated test cases.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dongjoon-hyun/spark SPARK-25971
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22972.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22972
----
commit ea768d03d1577d5ed265bcac175522d3e63a34e2
Author: Dongjoon Hyun <dongjoon@...>
Date: 2018-11-08T07:56:23Z
[SPARK-25971][SQL] Ignore partition byte-size statistics in
SQLQueryTestSuite
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
