[GitHub] spark pull request #23142: [SPARK-26170][SS] Add missing metrics in FlatMapG...

[HeartSaVioR]

GitHub user HeartSaVioR opened a pull request:

    https://github.com/apache/spark/pull/23142

    [SPARK-26170][SS] Add missing metrics in FlatMapGroupsWithState

    ## What changes were proposed in this pull request?
    
    This patch addresses measuring possible metrics in StateStoreWriter to 
FlatMapGroupsWithStateExec. Please note that some metrics like time to remove 
elements are not addressed because they are coupled with state function.
    
    ## How was this patch tested?
    
    Manually tested with 
https://github.com/apache/spark/blob/master/examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredSessionization.scala.
    
    Snapshots below:
    
    ![screen shot 2018-11-26 at 4 13 40 
pm](https://user-images.githubusercontent.com/1317309/48999346-b5f7b400-f199-11e8-89c7-8795f13470d6.png)
    ![screen shot 2018-11-26 at 4 13 54 
pm](https://user-images.githubusercontent.com/1317309/48999347-b5f7b400-f199-11e8-91ef-ef0b2f816b2e.png)


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/HeartSaVioR/spark SPARK-26170

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/23142.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #23142
    
----
commit 56f39cc5838c3f609c8657639ac3a45991fde99f
Author: Jungtaek Lim (HeartSaVioR) <kabhwan@...>
Date:   2018-11-26T07:33:08Z

    SPARK-26170 Add missing metrics in FlatMapGroupsWithState

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org