[GitHub] spark pull request #21357: [SPARK-24311][SS] Refactor HDFSBackedStateStorePr...

[HeartSaVioR]

GitHub user HeartSaVioR opened a pull request:

    https://github.com/apache/spark/pull/21357

    [SPARK-24311][SS] Refactor HDFSBackedStateStoreProvider to remove 
duplicate…

    …d logic between operations on delta file and snapshot file
    
    ## What changes were proposed in this pull request?
    
    This patch refactors HDFSBackedStateStoreProvider to extract duplicated 
logic between operations on delta file and snapshot file, as well as 
documenting the structure of state file.
    
    ## How was this patch tested?
    
    Existing unit tests: StateStoreSuite

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/HeartSaVioR/spark SPARK-24311

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/21357.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #21357
    
----
commit 8ad2a3f8112662a865ee1dbaf7c5269197c3ee4f
Author: Jungtaek Lim <kabhwan@...>
Date:   2018-05-17T21:17:30Z

    SPARK-24311 Refactor HDFSBackedStateStoreProvider to remove duplicated 
logic between operations on delta file and snapshot file
    
    * also removed unused import statements

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org