[GitHub] spark pull request #16603: [SPARK-19244][Core] Sort MemoryConsumers accordin...

2017-01-17 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/16603#discussion_r96581689 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -144,8 +164,24 @@ public long acquireExecutionMemory(long required,

[GitHub] spark pull request #16613: [SPARK-19024][SQL] Implement new approach to writ...

2017-01-17 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16613#discussion_r96580856 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -275,21 +286,80 @@ case class AlterViewAsCommand(

[GitHub] spark issue #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema order a...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16606 **[Test build #71580 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71580/testReport)** for PR 16606 at commit

[GitHub] spark pull request #16613: [SPARK-19024][SQL] Implement new approach to writ...

2017-01-17 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16613#discussion_r96580761 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -207,29 +210,35 @@ case class CreateViewCommand( }

[GitHub] spark pull request #16613: [SPARK-19024][SQL] Implement new approach to writ...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16613#discussion_r96580350 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -275,21 +286,80 @@ case class AlterViewAsCommand(

[GitHub] spark pull request #16613: [SPARK-19024][SQL] Implement new approach to writ...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16613#discussion_r96580275 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -207,29 +210,35 @@ case class CreateViewCommand( }

[GitHub] spark issue #16613: [SPARK-19024][SQL] Implement new approach to write a per...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16613 **[Test build #71579 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71579/testReport)** for PR 16613 at commit

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16621 After merging https://github.com/apache/spark/pull/16517, it introduces a few conflicts. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #16517: [SPARK-18243][SQL] Port Hive writing to use FileF...

2017-01-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16517 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16517: [SPARK-18243][SQL] Port Hive writing to use FileFormat i...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16517 Thanks! Merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16624: [WIP] Add two test cases for `SET -v`.

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16624 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71571/ Test FAILed. ---

[GitHub] spark issue #16624: [WIP] Add two test cases for `SET -v`.

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16624 **[Test build #71571 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71571/testReport)** for PR 16624 at commit

[GitHub] spark issue #16624: [WIP] Add two test cases for `SET -v`.

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16624 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11867: [SPARK-14049] [CORE] Add functionality in spark history ...

2017-01-17 Thread paragpc
Github user paragpc commented on the issue: https://github.com/apache/spark/pull/11867 I am not sure why the build is failing with following error, stderr: fatal: unable to access 'https://github.com/apache/spark.git/': Failed connect to github.com:443; Operation now in

[GitHub] spark issue #11867: [SPARK-14049] [CORE] Add functionality in spark history ...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11867 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11867: [SPARK-14049] [CORE] Add functionality in spark history ...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11867 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71578/ Test FAILed. ---

[GitHub] spark issue #16517: [SPARK-18243][SQL] Port Hive writing to use FileFormat i...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16517 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71569/ Test PASSed. ---

[GitHub] spark issue #16517: [SPARK-18243][SQL] Port Hive writing to use FileFormat i...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16517 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16517: [SPARK-18243][SQL] Port Hive writing to use FileFormat i...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16517 **[Test build #71569 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71569/testReport)** for PR 16517 at commit

[GitHub] spark issue #16630: [SPARK-19270][ML] Add summary table to GLM summary

2017-01-17 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16630 The following code illustrates the idea of this PR. ``` val datasetWithWeight = Seq( (1.0, 1.0, 0.0, 5.0), (0.5, 2.0, 1.0, 2.0), (1.0, 3.0, 2.0, 1.0),

[GitHub] spark issue #11867: [SPARK-14049] [CORE] Add functionality in spark history ...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11867 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11867: [SPARK-14049] [CORE] Add functionality in spark history ...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11867 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71577/ Test FAILed. ---

[GitHub] spark issue #16630: [SPARK-19270][ML] Add summary table to GLM summary

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16630 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16605: [SPARK-18884][SQL] Support Array[_] in ScalaUDF

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16605 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71570/ Test PASSed. ---

[GitHub] spark issue #16605: [SPARK-18884][SQL] Support Array[_] in ScalaUDF

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16605 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16605: [SPARK-18884][SQL] Support Array[_] in ScalaUDF

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16605 **[Test build #71570 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71570/testReport)** for PR 16605 at commit

[GitHub] spark pull request #16630: [SPARK-19270][ML] Add summary table to GLM summar...

2017-01-17 Thread actuaryzhang
GitHub user actuaryzhang opened a pull request: https://github.com/apache/spark/pull/16630 [SPARK-19270][ML] Add summary table to GLM summary ## What changes were proposed in this pull request? Add R-like summary table to GLM summary, which includes feature name (if

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96577649 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -215,37 +215,43 @@ case class

[GitHub] spark issue #16585: [SPARK-19223][SQL][PySpark] Fix InputFileBlockHolder for...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16585 LGTM, pending jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96577543 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala --- @@ -1322,4 +1322,26 @@ class MetastoreDataSourcesSuite

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96577471 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -1626,17 +1626,6 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96577427 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -215,37 +215,43 @@ case class

[GitHub] spark issue #16605: [SPARK-18884][SQL] Support Array[_] in ScalaUDF

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16605 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71568/ Test PASSed. ---

[GitHub] spark issue #16605: [SPARK-18884][SQL] Support Array[_] in ScalaUDF

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16605 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16605: [SPARK-18884][SQL] Support Array[_] in ScalaUDF

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16605 **[Test build #71568 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71568/testReport)** for PR 16605 at commit

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96576872 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -586,12 +594,12 @@ class SessionCatalog(

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16621 **[Test build #71576 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71576/testReport)** for PR 16621 at commit

[GitHub] spark issue #16517: [SPARK-18243][SQL] Port Hive writing to use FileFormat i...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16517 No concern after the latest changes. LGTM pending Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16621 No more comments. It looks pretty good! Let us see whether all the test cases can pass. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96575899 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1799,6 +1799,7 @@ class DDLSuite extends QueryTest with

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96575520 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -586,12 +594,12 @@ class SessionCatalog(

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16621 **[Test build #71574 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71574/testReport)** for PR 16621 at commit

[GitHub] spark issue #16585: [SPARK-19223][SQL][PySpark] Fix InputFileBlockHolder for...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16585 **[Test build #71575 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71575/testReport)** for PR 16585 at commit

[GitHub] spark pull request #16585: [SPARK-19223][SQL][PySpark] Fix InputFileBlockHol...

2017-01-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16585#discussion_r96574565 --- Diff: python/pyspark/sql/tests.py --- @@ -435,6 +435,31 @@ def test_udf_with_input_file_name(self): row =

[GitHub] spark pull request #16585: [SPARK-19223][SQL][PySpark] Fix InputFileBlockHol...

2017-01-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16585#discussion_r96574569 --- Diff: python/pyspark/sql/tests.py --- @@ -435,6 +435,31 @@ def test_udf_with_input_file_name(self): row =

[GitHub] spark issue #12064: [SPARK-14272][ML] Evaluate GaussianMixtureModel with Log...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12064 **[Test build #71573 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71573/testReport)** for PR 12064 at commit

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16621 **[Test build #71572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71572/testReport)** for PR 16621 at commit

[GitHub] spark pull request #16603: [SPARK-19244][Core] Sort MemoryConsumers accordin...

2017-01-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16603#discussion_r96574267 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -144,23 +170,31 @@ public long acquireExecutionMemory(long required,

[GitHub] spark pull request #16576: [SPARK-19215] Add necessary check for `RDD.checkp...

2017-01-17 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/16576#discussion_r96573963 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1539,6 +1539,9 @@ abstract class RDD[T: ClassTag]( // NOTE: we use a

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16621 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71567/ Test FAILed. ---

[GitHub] spark pull request #16603: [SPARK-19244][Core] Sort MemoryConsumers accordin...

2017-01-17 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/16603#discussion_r96572902 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -144,23 +170,31 @@ public long acquireExecutionMemory(long required,

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16621 Sure. No problem. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16621 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16621 can we do it later? We are going to merge `CatalogRelation` implementations and unify the table relation representations soon. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16621 **[Test build #71567 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71567/testReport)** for PR 16621 at commit

[GitHub] spark pull request #16585: [SPARK-19223][SQL][PySpark] Fix InputFileBlockHol...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16585#discussion_r96572553 --- Diff: python/pyspark/sql/tests.py --- @@ -435,6 +435,31 @@ def test_udf_with_input_file_name(self): row =

[GitHub] spark pull request #16585: [SPARK-19223][SQL][PySpark] Fix InputFileBlockHol...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16585#discussion_r96572514 --- Diff: python/pyspark/sql/tests.py --- @@ -435,6 +435,31 @@ def test_udf_with_input_file_name(self): row =

[GitHub] spark issue #16621: [SPARK-19265][SQL] make table relation cache general and...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16621 Could we rename `SimpleCatalogRelation` to `UnresolvedCatalogRelation`? The current name looks very confusing to me. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96572359 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -215,37 +215,44 @@ case class

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13599 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71564/ Test PASSed. ---

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13599 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13599 **[Test build #71564 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71564/testReport)** for PR 13599 at commit

[GitHub] spark issue #16624: [WIP] Add two test cases for `SET -v`.

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16624 **[Test build #71571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71571/testReport)** for PR 16624 at commit

[GitHub] spark issue #12064: [SPARK-14272][ML] Evaluate GaussianMixtureModel with Log...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71566/ Test FAILed. ---

[GitHub] spark issue #12064: [SPARK-14272][ML] Evaluate GaussianMixtureModel with Log...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12064 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96571473 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -650,14 +659,21 @@ class SessionCatalog(

[GitHub] spark issue #12064: [SPARK-14272][ML] Evaluate GaussianMixtureModel with Log...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12064 **[Test build #71566 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71566/testReport)** for PR 12064 at commit

[GitHub] spark issue #16547: [SPARK-19168][Structured Streaming] StateStore should be...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16547 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71565/ Test PASSed. ---

[GitHub] spark issue #16547: [SPARK-19168][Structured Streaming] StateStore should be...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16547 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16585: [SPARK-19223][SQL][PySpark] Fix InputFileBlockHolder for...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16585 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71561/ Test PASSed. ---

[GitHub] spark issue #16547: [SPARK-19168][Structured Streaming] StateStore should be...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16547 **[Test build #71565 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71565/testReport)** for PR 16547 at commit

[GitHub] spark issue #16585: [SPARK-19223][SQL][PySpark] Fix InputFileBlockHolder for...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16585 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16585: [SPARK-19223][SQL][PySpark] Fix InputFileBlockHolder for...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16585 **[Test build #71561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71561/testReport)** for PR 16585 at commit

[GitHub] spark issue #16609: [SPARK-8480] [CORE] [PYSPARK] [SPARKR] Add setName for D...

2017-01-17 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16609 @emlyn I'm not sure this should be associated with RDD, since we are working with DataFrame here? As for the existing `name` methods in RDD.R - they are not public APIs --- If your project

[GitHub] spark pull request #16621: [SPARK-19265][SQL] make table relation cache gene...

2017-01-17 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16621#discussion_r96570432 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -215,37 +215,44 @@ case class

[GitHub] spark pull request #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema ...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16606#discussion_r96569991 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/PartitionedWriteSuite.scala --- @@ -92,6 +92,30 @@ class PartitionedWriteSuite extends

[GitHub] spark pull request #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema ...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16606#discussion_r96569809 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1374,4 +1377,47 @@ class HiveDDLSuite

[GitHub] spark issue #16623: [SPARK-19066][SPARKR][Backport-2.1]:LDA doesn't set opti...

2017-01-17 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16623 merged to 2.1. thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema ...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16606#discussion_r96569387 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1374,4 +1377,47 @@ class HiveDDLSuite

[GitHub] spark pull request #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema ...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16606#discussion_r96569222 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1374,4 +1377,47 @@ class HiveDDLSuite

[GitHub] spark pull request #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema ...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16606#discussion_r96569205 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1374,4 +1377,47 @@ class HiveDDLSuite

[GitHub] spark issue #16623: [SPARK-19066][SPARKR][Backport-2.1]:LDA doesn't set opti...

2017-01-17 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16623 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16606: [SPARK-19246][SQL]CataLogTable's partitionSchema ...

2017-01-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16606#discussion_r96569171 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -138,6 +138,7 @@ case class

[GitHub] spark pull request #16589: [SPARK-19231][SPARKR] add error handling for down...

2017-01-17 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16589#discussion_r96569089 --- Diff: R/pkg/R/install.R --- @@ -201,14 +221,20 @@ directDownloadTar <- function(mirrorUrl, version, hadoopVersion, packageName, pa msg <-

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-17 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16503 @vanzin Sorry for the stupid mistake I made. I've changed. Please take another look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #16589: [SPARK-19231][SPARKR] add error handling for down...

2017-01-17 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16589#discussion_r96567761 --- Diff: R/pkg/R/install.R --- @@ -201,14 +221,20 @@ directDownloadTar <- function(mirrorUrl, version, hadoopVersion, packageName, pa msg <-

[GitHub] spark pull request #16589: [SPARK-19231][SPARKR] add error handling for down...

2017-01-17 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16589#discussion_r96289817 --- Diff: R/pkg/R/install.R --- @@ -54,7 +54,7 @@ #' } #' @param overwrite If \code{TRUE}, download and overwrite the existing

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16503 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16503 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71560/ Test PASSed. ---

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71558/ Test PASSed. ---

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16503 **[Test build #71558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71558/testReport)** for PR 16503 at commit

[GitHub] spark issue #16503: [SPARK-18113] Use ask to replace askWithRetry in canComm...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16503 **[Test build #71560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71560/testReport)** for PR 16503 at commit

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14204 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71557/ Test PASSed. ---

[GitHub] spark pull request #14204: [SPARK-16520] [WEBUI] Link executors to correspon...

2017-01-17 Thread nblintao
Github user nblintao commented on a diff in the pull request: https://github.com/apache/spark/pull/14204#discussion_r96568190 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -408,12 +420,17 @@ $(document).ready(function () {

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71556/ Test PASSed. ---

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2017-01-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14204 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #71556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71556/testReport)** for PR 15125 at commit

[GitHub] spark issue #14204: [SPARK-16520] [WEBUI] Link executors to corresponding wo...

2017-01-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14204 **[Test build #71557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71557/testReport)** for PR 14204 at commit

  1   2   3   4   5   6   7   >