[GitHub] spark pull request #21370: [SPARK-24215][PySpark] Implement _repr_html_ for ...

[xuanyuanking]

GitHub user xuanyuanking opened a pull request:

    https://github.com/apache/spark/pull/21370

    [SPARK-24215][PySpark] Implement _repr_html_ for dataframes in PySpark

    ## What changes were proposed in this pull request?
    
    Implement _repr_html_ for PySpark while in notebook and add config named 
"spark.jupyter.eagerEval.enabled" to control this.
    
    The dev list thread for context: 
http://apache-spark-developers-list.1001551.n3.nabble.com/eager-execution-and-debuggability-td23928.html
    
    ## How was this patch tested?
    
    New ut in DataFrameSuite and manual test in jupyter. Some screenshot below:
    
![image](https://user-images.githubusercontent.com/4833765/40268422-8db5bef0-5b9f-11e8-80f1-04bc654a4f2c.png)
    
![image](https://user-images.githubusercontent.com/4833765/40268431-9f92c1b8-5b9f-11e8-9db9-0611f0940b26.png)
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/xuanyuanking/spark SPARK-24215

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/21370.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #21370
    
----
commit ebc0b11fd006386d32949f56228e2671297373fc
Author: Yuanjian Li <xyliyuanjian@...>
Date:   2018-05-19T11:56:02Z

    SPARK-24215: Implement __repr__ and _repr_html_ for dataframes in PySpark

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org