[GitHub] spark pull request: [SPARK-14433][PySpark][ML]:PySpark ml Gaussian...

2016-04-15 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12402#discussion_r59833733 --- Diff: python/pyspark/ml/clustering.py --- @@ -22,7 +22,151 @@ from pyspark.mllib.common import inherit_doc __all__ = ['BisectingKMeans'

[GitHub] spark pull request: [SPARK-14433][PySpark][ML]:PySpark ml Gaussian...

2016-04-15 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12402#discussion_r59833895 --- Diff: python/pyspark/ml/clustering.py --- @@ -22,7 +22,151 @@ from pyspark.mllib.common import inherit_doc __all__ = ['BisectingKMeans'

[GitHub] spark pull request: [SPARK-14445][SQL] Support native execution of...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1#issuecomment-210317598 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14445][SQL] Support native execution of...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1#issuecomment-210317168 **[Test build #55901 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55901/consoleFull)** for PR 1 at commit [`1171a90`](https://g

[GitHub] spark pull request: [SPARK-14445][SQL] Support native execution of...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1#issuecomment-210317592 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14433][PySpark][ML]:PySpark ml Gaussian...

2016-04-15 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12402#discussion_r59834165 --- Diff: python/pyspark/ml/clustering.py --- @@ -22,7 +22,151 @@ from pyspark.mllib.common import inherit_doc __all__ = ['BisectingKMeans'

[GitHub] spark pull request: [SPARK-14433][PySpark][ML]:PySpark ml Gaussian...

2016-04-15 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12402#discussion_r59834247 --- Diff: python/pyspark/ml/clustering.py --- @@ -22,7 +22,151 @@ from pyspark.mllib.common import inherit_doc __all__ = ['BisectingKMeans'

[GitHub] spark pull request: [SPARK-14647][SQL] Group SQLContext/HiveContex...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12405#issuecomment-210319196 **[Test build #55903 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55903/consoleFull)** for PR 12405 at commit [`5539c1b`](https://g

[GitHub] spark pull request: [SPARK-14647][SQL] Group SQLContext/HiveContex...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12405#issuecomment-210319246 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14647][SQL] Group SQLContext/HiveContex...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12405#issuecomment-210319254 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13231] Make count failed values a user ...

2016-04-15 Thread ScrapCodes
Github user ScrapCodes closed the pull request at: https://github.com/apache/spark/pull/5 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13231] Make count failed values a user ...

2016-04-15 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/5#issuecomment-210324204 @andrewor14 As far as I knew, it worked fine. There is a check in Task.collectAccumulatorUpdates, you mean that check is not sufficient ? Ahh looking at the jira, I

[GitHub] spark pull request: [SPARK-14433][PySpark][ML]:PySpark ml Gaussian...

2016-04-15 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12402#discussion_r59834954 --- Diff: python/pyspark/ml/clustering.py --- @@ -22,7 +22,151 @@ from pyspark.mllib.common import inherit_doc __all__ = ['BisectingKMeans'

[GitHub] spark pull request: [SPARK-14433][PySpark][ML]:PySpark ml Gaussian...

2016-04-15 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/12402#discussion_r59834991 --- Diff: python/pyspark/ml/clustering.py --- @@ -22,7 +22,151 @@ from pyspark.mllib.common import inherit_doc __all__ = ['BisectingKMeans'

[GitHub] spark pull request: [SPARK-14549][ML] Copy the Vector and Matrix c...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12317#issuecomment-210328578 **[Test build #55902 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55902/consoleFull)** for PR 12317 at commit [`e626d1d`](https://g

[GitHub] spark pull request: [SPARK-14549][ML] Copy the Vector and Matrix c...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12317#issuecomment-210328835 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14549][ML] Copy the Vector and Matrix c...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12317#issuecomment-210328832 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14580][SQL] Hive IfCoercion should pres...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12340#issuecomment-210337909 **[Test build #55907 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55907/consoleFull)** for PR 12340 at commit [`fa3e95a`](https://gi

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/12410 [WIP] [SQL] Towards removing HiveContext ## This PR does not run thrift server tests because jenkins run those tests first and will fail the build if there is any failure. I'd like to know how many

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12410#issuecomment-210341447 **[Test build #55908 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55908/consoleFull)** for PR 12410 at commit [`69e778d`](https://gi

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12410#issuecomment-210341701 **[Test build #55908 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55908/consoleFull)** for PR 12410 at commit [`69e778d`](https://g

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12410#issuecomment-210341706 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12410#issuecomment-210341704 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14580][SQL] Hive IfCoercion should pres...

2016-04-15 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/12340#discussion_r59837905 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/misc.scala --- @@ -487,6 +487,50 @@ case class PrintToStderr(child: Expression)

[GitHub] spark pull request: [SPARK-14631][SQL]drop database cascade should...

2016-04-15 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/12391#discussion_r59838034 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogSuite.scala --- @@ -17,20 +17,22 @@ package org.apache.spark.s

[GitHub] spark pull request: [SPARK-14580][SQL] Hive IfCoercion should pres...

2016-04-15 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/12340#discussion_r59838031 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/misc.scala --- @@ -487,6 +487,50 @@ case class PrintToStderr(child: Expression)

[GitHub] spark pull request: [SPARK-14580][SQL] Hive IfCoercion should pres...

2016-04-15 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/12340#discussion_r59838077 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/misc.scala --- @@ -487,6 +487,50 @@ case class PrintToStderr(child: Expression)

[GitHub] spark pull request: [SPARK-14580][SQL] Hive IfCoercion should pres...

2016-04-15 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12340#issuecomment-210342856 can you create a new jira ticket for assert_true, and put both in the title? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-14483][WEBUI] Display user name for eac...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12257#issuecomment-210344607 **[Test build #55904 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55904/consoleFull)** for PR 12257 at commit [`e6c0c3b`](https://g

[GitHub] spark pull request: [SPARK-14483][WEBUI] Display user name for eac...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12257#issuecomment-210344727 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14483][WEBUI] Display user name for eac...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12257#issuecomment-210344729 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14483][WEBUI] Display user name for eac...

2016-04-15 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/12257#issuecomment-210345071 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-14483][WEBUI] Display user name for eac...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12257#issuecomment-210346298 **[Test build #55909 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55909/consoleFull)** for PR 12257 at commit [`e6c0c3b`](https://gi

[GitHub] spark pull request: [SPARK-14603] [SQL] [WIP] Verification of Meta...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12385#issuecomment-210346378 **[Test build #55906 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55906/consoleFull)** for PR 12385 at commit [`8b204ca`](https://g

[GitHub] spark pull request: [SPARK-14603] [SQL] [WIP] Verification of Meta...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12385#issuecomment-210346501 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14580][SQL] Hive IfCoercion should pres...

2016-04-15 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/12340#issuecomment-210346484 Thank you for fast review. I'll update and create the JIRA. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-14603] [SQL] [WIP] Verification of Meta...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12385#issuecomment-210346502 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14445][SQL] Support native execution of...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1#issuecomment-210346717 **[Test build #55905 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55905/consoleFull)** for PR 1 at commit [`587263b`](https://g

[GitHub] spark pull request: [SPARK-14445][SQL] Support native execution of...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1#issuecomment-210346924 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14445][SQL] Support native execution of...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1#issuecomment-210346927 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14628][WIP] Simplify task metrics by al...

2016-04-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12388#discussion_r59839605 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -434,50 +434,50 @@ class JobProgressListener(conf: SparkConf) exten

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12410#issuecomment-210347156 **[Test build #55910 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55910/consoleFull)** for PR 12410 at commit [`496bea1`](https://gi

[GitHub] spark pull request: [SPARK-14628][WIP] Simplify task metrics by al...

2016-04-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12388#discussion_r59840023 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala --- @@ -434,50 +434,50 @@ class JobProgressListener(conf: SparkConf) exten

[GitHub] spark pull request: [SPARK-14580][SQL] Hive IfCoercion should pres...

2016-04-15 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/12340#discussion_r59840175 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/misc.scala --- @@ -487,6 +487,50 @@ case class PrintToStderr(child: Ex

[GitHub] spark pull request: [SPARK-14549][ML] Copy the Vector and Matrix c...

2016-04-15 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/12317#issuecomment-210353251 LGTM. Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-14549][ML] Copy the Vector and Matrix c...

2016-04-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12317 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/12410#issuecomment-210356553 `org.apache.spark.sql.hive.execution.SQLQuerySuite.sanity test for SPARK-6618` will fail because we will not use executionHive to protect the call of parseSql. So, `def h

[GitHub] spark pull request: [MINOR][SQL] Remove extra anonymous closure wi...

2016-04-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/12382#issuecomment-210358749 @andrewor14 Hm.. I tried to add a rule but I realised (or I think) it cannot find perfectly by a static way. One of the problems I met was below: For exampl

[GitHub] spark pull request: [MINOR][SQL] Remove extra anonymous closure wi...

2016-04-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/12382#issuecomment-210359106 @andrewor14 @srowen Do you mind If I open another PR for some more corrections? While trying to test regular expressions, I found some more things to corre

[GitHub] spark pull request: [SPARK-14370][MLLIB]removed duplicate generati...

2016-04-15 Thread pravingadakh
Github user pravingadakh commented on a diff in the pull request: https://github.com/apache/spark/pull/12176#discussion_r59844091 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala --- @@ -536,13 +532,16 @@ private[clustering] object OnlineLDAOptimi

[GitHub] spark pull request: [SPARK-13484][SQL] Prevent illegal NULL propag...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11371#issuecomment-210367560 **[Test build #55911 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55911/consoleFull)** for PR 11371 at commit [`441d9a5`](https://gi

[GitHub] spark pull request: [MINOR][SQL] Remove extra anonymous closure wi...

2016-04-15 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12382#issuecomment-210369151 If there's a built-in scalastyle rule for this, let's enable it, but otherwise not sure it's worth building custom code to enforce it. If you've found ways to look for m

[GitHub] spark pull request: [SPARK-14580][SPARK-14655][SQL] Hive IfCoercio...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12340#issuecomment-210373329 **[Test build #55907 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55907/consoleFull)** for PR 12340 at commit [`fa3e95a`](https://g

[GitHub] spark pull request: [SPARK-14580][SPARK-14655][SQL] Hive IfCoercio...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12340#issuecomment-210373810 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14580][SPARK-14655][SQL] Hive IfCoercio...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12340#issuecomment-210373814 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14645][MESOS] Fix python running on clu...

2016-04-15 Thread dragos
Github user dragos commented on the pull request: https://github.com/apache/spark/pull/12403#issuecomment-210375089 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-14656][Core] Fix Benchmark.getPorcessor...

2016-04-15 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/12411 [SPARK-14656][Core] Fix Benchmark.getPorcessorName() always return "Unknown processor" on Linux ## What changes were proposed in this pull request? This PR returns correct processor name in ```/p

[GitHub] spark pull request: [SPARK-14609][SQL] Native support for LOAD DAT...

2016-04-15 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/12412 [SPARK-14609][SQL] Native support for LOAD DATA DDL command ## What changes were proposed in this pull request? Add the native support for LOAD DATA DDL command that loads data into Hive ta

[GitHub] spark pull request: [SPARK-14656][Core] Fix Benchmark.getPorcessor...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12411#issuecomment-210375881 **[Test build #55912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55912/consoleFull)** for PR 12411 at commit [`b6ea54e`](https://gi

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12410#issuecomment-210376394 **[Test build #55910 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55910/consoleFull)** for PR 12410 at commit [`496bea1`](https://g

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12410#issuecomment-210376596 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [WIP] [SQL] Towards removing HiveContext

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12410#issuecomment-210376598 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14609][SQL] Native support for LOAD DAT...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12412#issuecomment-210377132 **[Test build #55913 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55913/consoleFull)** for PR 12412 at commit [`d8aaae6`](https://gi

[GitHub] spark pull request: [SPARK-14370][MLLIB]removed duplicate generati...

2016-04-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12176#discussion_r59848898 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala --- @@ -536,13 +532,16 @@ private[clustering] object OnlineLDAOptimizer {

[GitHub] spark pull request: [MINOR] Remove inappropriate type notation and...

2016-04-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/12413#issuecomment-210381977 cc @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [MINOR] Remove inappropriate type notation and...

2016-04-15 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/12413 [MINOR] Remove inappropriate type notation and extra anonymous closure within functional transformations ## What changes were proposed in this pull request? This PR removes -

[GitHub] spark pull request: [SPARK-14636] Add minimum memory checks for dr...

2016-04-15 Thread peterableda
Github user peterableda commented on a diff in the pull request: https://github.com/apache/spark/pull/12395#discussion_r59849405 --- Diff: core/src/main/scala/org/apache/spark/memory/StaticMemoryManager.scala --- @@ -104,6 +104,8 @@ private[spark] class StaticMemoryManager(

[GitHub] spark pull request: [MINOR] Remove inappropriate type notation and...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12413#issuecomment-210383168 **[Test build #55914 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55914/consoleFull)** for PR 12413 at commit [`bd7dec4`](https://gi

[GitHub] spark pull request: [SPARK-14580][SPARK-14655][SQL] Hive IfCoercio...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12340#issuecomment-210383165 **[Test build #55915 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55915/consoleFull)** for PR 12340 at commit [`bdcef78`](https://gi

[GitHub] spark pull request: [SPARK-7481][build][WIP] Add Hadoop 2.6+ spark...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12004#issuecomment-210383201 **[Test build #55916 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55916/consoleFull)** for PR 12004 at commit [`105de0b`](https://gi

[GitHub] spark pull request: [SPARK-14480][SQL] Simplify CSV parsing proces...

2016-04-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/12268#issuecomment-210383858 Could I please cc @falaki who I believe is the original author? --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: SPARK-14321. [SQL] Reduce date format cost and...

2016-04-15 Thread rajeshbalamohan
Github user rajeshbalamohan commented on the pull request: https://github.com/apache/spark/pull/12105#issuecomment-210384204 Revised the patch addressing comments. Fixed eval() of UnixTime, FromUnixTime. Haven't changed eval in DateFormatClass as i am not sure if format can change in

[GitHub] spark pull request: [SPARK-14609][SQL] Native support for LOAD DAT...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12412#issuecomment-210384544 **[Test build #55913 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55913/consoleFull)** for PR 12412 at commit [`d8aaae6`](https://g

[GitHub] spark pull request: [SPARK-14609][SQL] Native support for LOAD DAT...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12412#issuecomment-210384612 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14609][SQL] Native support for LOAD DAT...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12412#issuecomment-210384615 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14636] Add minimum memory checks for dr...

2016-04-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12395#discussion_r59850951 --- Diff: core/src/main/scala/org/apache/spark/memory/StaticMemoryManager.scala --- @@ -104,6 +104,8 @@ private[spark] class StaticMemoryManager( p

[GitHub] spark pull request: [MINOR] Remove inappropriate type notation and...

2016-04-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12413#discussion_r59851195 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -149,8 +149,8 @@ case class ExceptionFailure( this(e, accumUpdates, preserve

[GitHub] spark pull request: [MINOR] Remove inappropriate type notation and...

2016-04-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12413#discussion_r59851263 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -131,7 +131,7 @@ trait JavaRDDLike[T, This <: JavaRDDLike[T, This]] extends

[GitHub] spark pull request: [MINOR] Remove inappropriate type notation and...

2016-04-15 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/12413#issuecomment-210393625 LGTM with a few questions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-14483][WEBUI] Display user name for eac...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12257#issuecomment-210396203 **[Test build #55909 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55909/consoleFull)** for PR 12257 at commit [`e6c0c3b`](https://g

[GitHub] spark pull request: [SPARK-14483][WEBUI] Display user name for eac...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12257#issuecomment-210396502 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14483][WEBUI] Display user name for eac...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12257#issuecomment-210396499 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14370][MLLIB]removed duplicate generati...

2016-04-15 Thread pravingadakh
Github user pravingadakh commented on a diff in the pull request: https://github.com/apache/spark/pull/12176#discussion_r59852468 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala --- @@ -536,13 +532,16 @@ private[clustering] object OnlineLDAOptimi

[GitHub] spark pull request: [SPARK-14609][SQL] Native support for LOAD DAT...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12412#issuecomment-210396681 **[Test build #55917 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55917/consoleFull)** for PR 12412 at commit [`d15c7a3`](https://gi

[GitHub] spark pull request: [MINOR] Remove inappropriate type notation and...

2016-04-15 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12413#discussion_r59852563 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala --- @@ -131,7 +131,7 @@ trait JavaRDDLike[T, This <: JavaRDDLike[T, This]] ext

[GitHub] spark pull request: [MINOR] Remove inappropriate type notation and...

2016-04-15 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12413#discussion_r59852942 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -149,8 +149,8 @@ case class ExceptionFailure( this(e, accumUpdates, pre

[GitHub] spark pull request: [SPARK-14657] [ML] RFormula w/o intercept, we ...

2016-04-15 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/12414 [SPARK-14657] [ML] RFormula w/o intercept, we should output reference category when encoding string terms ## What changes were proposed in this pull request? (Please fill in changes pro

[GitHub] spark pull request: [SPARK-13484][SQL] Prevent illegal NULL propag...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11371#issuecomment-210402524 **[Test build #55911 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55911/consoleFull)** for PR 11371 at commit [`441d9a5`](https://g

[GitHub] spark pull request: [SPARK-13484][SQL] Prevent illegal NULL propag...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11371#issuecomment-210402776 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13484][SQL] Prevent illegal NULL propag...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11371#issuecomment-210402778 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14657] [ML] RFormula w/o intercept shou...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12414#issuecomment-210403003 **[Test build #55918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55918/consoleFull)** for PR 12414 at commit [`167beae`](https://gi

[GitHub] spark pull request: [BUG] LinearRegressionModel use default parame...

2016-04-15 Thread shkdee
GitHub user shkdee opened a pull request: https://github.com/apache/spark/pull/12415 [BUG] LinearRegressionModel use default parameters if yStd is 0 ## What changes were proposed in this pull request? In the (rare) case where yStd is 0 in LinearRegression, parameters are not

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12259#issuecomment-210406323 **[Test build #55919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55919/consoleFull)** for PR 12259 at commit [`ba9e910`](https://gi

[GitHub] spark pull request: [BUG] LinearRegressionModel use default parame...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12415#issuecomment-210406159 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12259#issuecomment-210406956 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12259#issuecomment-210406958 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14487][SQL] User Defined Type registrat...

2016-04-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12259#issuecomment-210406941 **[Test build #55919 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55919/consoleFull)** for PR 12259 at commit [`ba9e910`](https://g

[GitHub] spark pull request: [SPARK-14609][SQL] Native support for LOAD DAT...

2016-04-15 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12412#discussion_r59855917 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -880,6 +882,8 @@ INDEXES: 'INDEXES'; LOCKS: 'LOCKS';

[GitHub] spark pull request: [SPARK-14609][SQL] Native support for LOAD DAT...

2016-04-15 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12412#discussion_r59856683 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/commands.scala --- @@ -255,3 +258,88 @@ case class CreateMetastoreDataSourceAsSelect

[GitHub] spark pull request: [SPARK-14609][SQL] Native support for LOAD DAT...

2016-04-15 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/12412#discussion_r59856710 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/commands.scala --- @@ -255,3 +258,88 @@ case class CreateMetastoreDataSourceAsSelect

  1   2   3   4   5   6   7   8   >