GitHub user wangyum opened a pull request:

    https://github.com/apache/spark/pull/22636

    [SPARK-25629][TEST] Reduce ParquetFilterSuite: filter pushdown test time 
costs in Jenkins

    ## What changes were proposed in this pull request?
    
    Only these 4 writers is enough:
    
https://github.com/apache/spark/blob/be2238fb502b0f49a8a1baa6da9bc3e99540b40e/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetWriteSupport.scala#L269-L279
    
    ## How was this patch tested?
    
    Manual tests on my local machine.
    before:
    ```
    - filter pushdown - decimal (13 seconds, 683 milliseconds)
    ```
    after:
    ```
    - filter pushdown - decimal (9 seconds, 713 milliseconds)
    ```


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/wangyum/spark SPARK-25629

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/22636.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #22636
    
----
commit e40d79ce33941800408a0697e433ea4d0b20b3b5
Author: Yuming Wang <yumwang@...>
Date:   2018-10-05T02:41:28Z

    Reduce iteration times

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to