[GitHub] spark pull request #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations...

[cloud-fan]

GitHub user cloud-fan opened a pull request:

    https://github.com/apache/spark/pull/18064

    [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL UI tab

    ## What changes were proposed in this pull request?
    
    Currently the `DataFrameWriter` operations have several problems:
    
    1. non-file-format data source writing action doesn't show up in the SQL 
tab in Spark UI
    2. file-format data source writing action shows a scan node in the SQL tab, 
without saying anything about writing.
    3. Spark SQL CLI actions don't show up in the SQL tab.
    
    This PR fixes all of them, by refactoring the `ExecuteCommandExec` to make 
it have children.
    
     close https://github.com/apache/spark/pull/17540
    
    ## How was this patch tested?
    
    existing tests.
    
    Also test the UI manually. For a simple command: `Seq(1 -> "a").toDF("i", 
"j").write.parquet("/tmp/qwe")`
    
    before this PR:
    <img width="266" alt="qq20170523-035840 2x" 
src="https://cloud.githubusercontent.com/assets/3182036/26326050/24e18ba2-3f6c-11e7-8817-6dd275bf6ac5.png";>
    after this PR:
    <img width="287" alt="qq20170523-035708 2x" 
src="https://cloud.githubusercontent.com/assets/3182036/26326054/2ad7f460-3f6c-11e7-8053-d68325beb28f.png";>


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/cloud-fan/spark execution

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/18064.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #18064
    
----
commit 5c24f5ac2b1740a0cf08346a85111a2c06920309
Author: Wenchen Fan <wenc...@databricks.com>
Date:   2017-05-22T19:51:13Z

    Fix DataFrameWriter operations in SQL UI tab

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org