[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-07 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r55290303 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,60 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=None):

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-07 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r55258804 --- Diff: python/pyspark/sql/types.py --- @@ -681,6 +681,139 @@ def __eq__(self, other): for v in [ArrayType, MapType, StructType

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-07 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-193384541 @cloud-fan What's the reason we do not want to improve createDataFrame() directly? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-192075891 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-192075897 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-192075706 **[Test build #52437 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52437/consoleFull)** for PR 11444 at commit [`d739239`](https://g

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-192070415 **[Test build #52437 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52437/consoleFull)** for PR 11444 at commit [`d739239`](https://gi

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54980428 --- Diff: python/pyspark/sql/types.py --- @@ -681,6 +681,129 @@ def __eq__(self, other): for v in [ArrayType, MapType, Struct

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54980380 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,56 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=Non

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54980211 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,56 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=Non

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54979899 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,56 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=None):

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54979766 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,56 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=None):

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54979708 --- Diff: python/pyspark/sql/types.py --- @@ -681,6 +681,129 @@ def __eq__(self, other): for v in [ArrayType, MapType, StructTyp

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54979408 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,56 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=None):

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54979311 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,56 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=Non

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54979292 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,56 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=Non

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54979106 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,56 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=None):

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-03 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11444#discussion_r54979052 --- Diff: python/pyspark/sql/context.py --- @@ -50,18 +50,56 @@ def _monkey_patch_RDD(sqlContext): def toDF(self, schema=None, sampleRatio=None):

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191632150 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191632158 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191631690 **[Test build #52380 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52380/consoleFull)** for PR 11444 at commit [`57eea79`](https://g

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191621204 **[Test build #52380 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52380/consoleFull)** for PR 11444 at commit [`57eea79`](https://gi

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191580114 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191580120 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191579982 **[Test build #52366 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52366/consoleFull)** for PR 11444 at commit [`dd2c929`](https://g

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191577686 **[Test build #52366 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52366/consoleFull)** for PR 11444 at commit [`dd2c929`](https://gi

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191575732 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191575730 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191575690 **[Test build #52363 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52363/consoleFull)** for PR 11444 at commit [`30f4137`](https://g

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191573386 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191573388 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191573361 **[Test build #52362 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52362/consoleFull)** for PR 11444 at commit [`a29cbb5`](https://g

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191572121 **[Test build #52363 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52363/consoleFull)** for PR 11444 at commit [`30f4137`](https://gi

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191571532 **[Test build #52362 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52362/consoleFull)** for PR 11444 at commit [`a29cbb5`](https://gi

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191567153 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191567147 **[Test build #52358 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52358/consoleFull)** for PR 11444 at commit [`ff65b19`](https://g

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191567151 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191566939 **[Test build #52358 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52358/consoleFull)** for PR 11444 at commit [`ff65b19`](https://gi

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191565432 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191565430 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191565428 **[Test build #52357 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52357/consoleFull)** for PR 11444 at commit [`e907933`](https://g

[GitHub] spark pull request: [SPARK-13593][SQL] improve the `toDF()` method...

2016-03-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11444#issuecomment-191565111 **[Test build #52357 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52357/consoleFull)** for PR 11444 at commit [`e907933`](https://gi