[GitHub] spark issue #14182: [SPARK-16444][SparkR]: Isotonic Regression wrapper in Sp...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14182 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14182: [SPARK-16444][SparkR]: Isotonic Regression wrapper in Sp...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14182 **[Test build #63663 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63663/consoleFull)** for PR 14182 at commit

[GitHub] spark issue #14392: [SPARK-16446] [SparkR] [ML] Gaussian Mixture Model wrapp...

2016-08-11 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14392 Yeah I am not sure `mvnormalmixEM` is very descriptive. @junyangq Any opinions on the name here ? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14431: [SPARK-16258][SparkR] Automatically append the grouping ...

2016-08-11 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/14431 yes, @shivaram , that will be one way to do. Basically, adding a new public function to `RelationalGroupedDataset` which will return the column names. If it is fine from SQL perspective,

[GitHub] spark pull request #14559: [SPARK-16968]Add additional options in jdbc when ...

2016-08-11 Thread GraceH
Github user GraceH commented on a diff in the pull request: https://github.com/apache/spark/pull/14559#discussion_r74542628 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCOptions.scala --- @@ -20,14 +20,21 @@ package

[GitHub] spark issue #14559: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14559 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63662/ Test FAILed. ---

[GitHub] spark issue #14559: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14559 **[Test build #63662 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63662/consoleFull)** for PR 14559 at commit

[GitHub] spark issue #14559: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-11 Thread GraceH
Github user GraceH commented on the issue: https://github.com/apache/spark/pull/14559 Thanks all. I have added the unit test in JDBCWriterSuite. Any further comment, please feel free to let me know. BTW, or we can point the user to check JDBCOptions for further

[GitHub] spark issue #14559: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14559 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14558: [SPARK-16508][SparkR] Fix warnings on undocumented/dupli...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14558 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63654/ Test PASSed. ---

[GitHub] spark issue #14558: [SPARK-16508][SparkR] Fix warnings on undocumented/dupli...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14558 **[Test build #63654 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63654/consoleFull)** for PR 14558 at commit

[GitHub] spark issue #14229: [SPARK-16447][ML][SparkR] LDA wrapper in SparkR

2016-08-11 Thread yinxusen
Github user yinxusen commented on the issue: https://github.com/apache/spark/pull/14229 @felixcheung I add some aliases for spark.lda related functions. However, I am not quite understand it. From [here](https://cran.r-project.org/web/packages/roxygen2/vignettes/rd.html) I can see

[GitHub] spark issue #14571: [SPARK-16983][SQL] Add `prettyName` for row_number, dens...

2016-08-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14571 Hi, @rxin . I added test files for window functions for SQLQueryTestSuite and removed the old `WindowQuerySuite.scala`. Could you review this again? --- If your project is set up for it,

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-11 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/14613 @shivaram Sure. I will add unit tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #63658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63658/consoleFull)** for PR 14452 at commit

[GitHub] spark issue #14617: [SPARK-17019][Core] Expose on-heap and off-heap memory u...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14617 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63656/ Test FAILed. ---

[GitHub] spark issue #14617: [SPARK-17019][Core] Expose on-heap and off-heap memory u...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14617 **[Test build #63656 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63656/consoleFull)** for PR 14617 at commit

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-11 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14452 @gatorsmile I've made some changes. I will update this soon. The optimized plan for the query is: Join Inner :- Join Inner : :- CommonSubquery [a#226, b#227,

[GitHub] spark issue #14617: [SPARK-17019][Core] Expose on-heap and off-heap memory u...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14617 **[Test build #63656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63656/consoleFull)** for PR 14617 at commit

[GitHub] spark issue #14608: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14608 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63652/ Test PASSed. ---

[GitHub] spark issue #14608: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14608 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14608: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14608 **[Test build #63652 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63652/consoleFull)** for PR 14608 at commit

[GitHub] spark pull request #14384: [Spark-16443][SparkR] Alternating Least Squares (...

2016-08-11 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14384#discussion_r74536489 --- Diff: R/pkg/R/mllib.R --- @@ -632,3 +642,159 @@ setMethod("predict", signature(object = "AFTSurvivalRegressionModel"), function(object,

[GitHub] spark pull request #14102: [SPARK-16434][SQL] Avoid per-record type dispatch...

2016-08-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14102 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14551: [SPARK-16961][CORE] Fixed off-by-one error that biased r...

2016-08-11 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/14551 @nicklavers Please also change seed for ```GaussianMixture``` doctest in ```python/pyspark/ml/clustering.py```. And check whether we need to change seed for ```KMeans``` doctest. Thanks. ---

[GitHub] spark pull request #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set p...

2016-08-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13146 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14616: [SPARK-16955][SQL] Fix analysis error when using ordinal...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14616 **[Test build #63655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63655/consoleFull)** for PR 14616 at commit

[GitHub] spark issue #13409: [SPARK-15667][SQL]Throw exception if columns number of o...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13409 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14616: [SPARK-16955][SQL] Fix analysis error when using ...

2016-08-11 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/14616 [SPARK-16955][SQL] Fix analysis error when using ordinal in ORDER BY or GROUP BY ## What changes were proposed in this pull request? This PR adds two unresolved expressions to represent

[GitHub] spark issue #14558: [SPARK-16508][SparkR] Fix warnings on undocumented/dupli...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14558 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14609: [MINOR][Core] fix warnings on depreciated methods in Mes...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14609 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63650/ Test FAILed. ---

[GitHub] spark issue #14530: [SPARK-16868][Web Ui] Fix executor be both dead and aliv...

2016-08-11 Thread SaintBacchus
Github user SaintBacchus commented on the issue: https://github.com/apache/spark/pull/14530 I will re-run this case, and dig into why the executor will double register. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #14607: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE (follow-up)

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14607 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14607: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE (follow-up)

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14607 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63646/ Test PASSed. ---

[GitHub] spark issue #14433: [SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn't work

2016-08-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14433 Can we have this like [SparkSubmitAction](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala#L55) that extends `Enumeration`? --- If

[GitHub] spark issue #14586: [SPARK-17003] [BUILD] [BRANCH-1.6] release-build.sh is m...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14586 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14447 so there are a few competing implementation in R and `mlp` might not be a super relevant name. @shivaram @mengxr any thought on `spark.mlp` here? --- If your project is set up for it, you can

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14447#discussion_r74530136 --- Diff: R/pkg/R/mllib.R --- @@ -533,6 +626,26 @@ setMethod("write.ml", signature(object = "KMeansModel", path = "character"),

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14447#discussion_r74530039 --- Diff: R/pkg/R/mllib.R --- @@ -414,6 +421,92 @@ setMethod("predict", signature(object = "KMeansModel"),

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14447#discussion_r74530043 --- Diff: R/pkg/R/mllib.R --- @@ -414,6 +421,92 @@ setMethod("predict", signature(object = "KMeansModel"),

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14447#discussion_r74529955 --- Diff: R/pkg/R/mllib.R --- @@ -487,7 +580,7 @@ setMethod("write.ml", signature(object = "NaiveBayesModel", path = "character"), #' @rdname

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14447#discussion_r74529891 --- Diff: R/pkg/R/mllib.R --- @@ -414,6 +421,92 @@ setMethod("predict", signature(object = "KMeansModel"),

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14447#discussion_r74529897 --- Diff: R/pkg/R/mllib.R --- @@ -414,6 +421,92 @@ setMethod("predict", signature(object = "KMeansModel"),

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14447#discussion_r74529661 --- Diff: R/pkg/R/mllib.R --- @@ -414,6 +421,92 @@ setMethod("predict", signature(object = "KMeansModel"),

[GitHub] spark issue #14612: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14612 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63645/ Test PASSed. ---

[GitHub] spark pull request #14522: [Spark-16508][SparkR] Split docs for arrange and ...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14522#discussion_r74529416 --- Diff: R/pkg/R/DataFrame.R --- @@ -2121,7 +2121,7 @@ setMethod("arrange", }) #' @rdname arrange -#' @name orderBy

[GitHub] spark pull request #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptro...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14447#discussion_r74529446 --- Diff: R/pkg/R/mllib.R --- @@ -53,6 +53,13 @@ setClass("AFTSurvivalRegressionModel", representation(jobj = "jobj")) #' @note KMeansModel since

[GitHub] spark issue #14612: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14612 **[Test build #63645 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63645/consoleFull)** for PR 14612 at commit

[GitHub] spark pull request #14384: [Spark-16443][SparkR] Alternating Least Squares (...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14384#discussion_r74527784 --- Diff: R/pkg/R/mllib.R --- @@ -632,3 +642,159 @@ setMethod("predict", signature(object = "AFTSurvivalRegressionModel"),

[GitHub] spark pull request #14182: [SPARK-16444][SparkR]: Isotonic Regression wrappe...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14182#discussion_r74527541 --- Diff: R/pkg/R/mllib.R --- @@ -292,6 +299,85 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori =

[GitHub] spark issue #14608: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14608 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63644/ Test FAILed. ---

[GitHub] spark issue #14608: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14608 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14608: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14608 **[Test build #63644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63644/consoleFull)** for PR 14608 at commit

[GitHub] spark pull request #14384: [Spark-16443][SparkR] Alternating Least Squares (...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14384#discussion_r74527216 --- Diff: R/pkg/R/mllib.R --- @@ -632,3 +642,159 @@ setMethod("predict", signature(object = "AFTSurvivalRegressionModel"),

[GitHub] spark issue #14614: [SPARK-17027][ML] Avoid integer overflow in PolynomialEx...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14614 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14614: [SPARK-17027][ML] Avoid integer overflow in PolynomialEx...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14614 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63649/ Test PASSed. ---

[GitHub] spark issue #14609: [MINOR][Core] fix warnings on depreciated methods in Mes...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14609 **[Test build #63650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63650/consoleFull)** for PR 14609 at commit

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14116 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14116 **[Test build #63641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63641/consoleFull)** for PR 14116 at commit

[GitHub] spark issue #14229: [SPARK-16447][ML][SparkR] LDA wrapper in SparkR

2016-08-11 Thread yinxusen
Github user yinxusen commented on the issue: https://github.com/apache/spark/pull/14229 @felixcheung Yes. Sorry I missed the email. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63639/ Test PASSed. ---

[GitHub] spark pull request #14182: [SPARK-16444][SparkR]: Isotonic Regression wrappe...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14182#discussion_r74526172 --- Diff: R/pkg/R/mllib.R --- @@ -292,6 +299,83 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori =

[GitHub] spark pull request #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor po...

2016-08-11 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11157#discussion_r74526303 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -358,6 +376,109 @@ private[mesos] trait

[GitHub] spark pull request #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor po...

2016-08-11 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11157#discussion_r74526278 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -358,6 +376,109 @@ private[mesos] trait

[GitHub] spark pull request #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor po...

2016-08-11 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11157#discussion_r74526246 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -358,6 +376,109 @@ private[mesos] trait

[GitHub] spark issue #14561: [SPARK-16972][CORE] Move DriverEndpoint out of CoarseGra...

2016-08-11 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14561 Agreed with @jerryshao. @lshmouse could you submit the whole refactoring PR in order to show why this one is necessary? It's better to not refactor stable code paths unless there is a strong

[GitHub] spark pull request #14182: [SPARK-16444][SparkR]: Isotonic Regression wrappe...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14182#discussion_r74525862 --- Diff: R/pkg/R/mllib.R --- @@ -292,6 +299,85 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori =

[GitHub] spark pull request #14182: [SPARK-16444][SparkR]: Isotonic Regression wrappe...

2016-08-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14182#discussion_r74525897 --- Diff: R/pkg/R/mllib.R --- @@ -292,6 +299,85 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori =

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-11 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14613 @wangmiao1981 Thanks for the PR. Could we add a couple of test cases for this ? It'll also help me understand what is the expected behavior -- one of them could be for `collect` with decimals and

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14613 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63648/ Test PASSed. ---

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14613 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-11 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/14546 I think a proper fix will be marking ordinal unresolved, the ordinal can exists in group by or order by expression. Then we can make sure the ResolveAggregateFunctions and other analyzer

[GitHub] spark issue #14392: [SPARK-16446] [SparkR] [ML] Gaussian Mixture Model wrapp...

2016-08-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14392 btw, I think it'll be great to get some feedback on the naming of this. As per SPARK-14831, should we go with a more Spark specific name like `gaussianmixture` rather than a R one? How well

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-11 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/14546 I think the root cause is that the Aggregate operator is treated as resolved if even it has group by ordinals. For example: ``` 'Filter ('a > 0) +- Aggregate [2], [count(1)

[GitHub] spark issue #14609: [MINOR][Core] fix warnings on depreciated methods in Mes...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14609 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63638/ Test FAILed. ---

[GitHub] spark pull request #14615: make toJSON not go through rdd form but operate o...

2016-08-11 Thread robert3005
GitHub user robert3005 opened a pull request: https://github.com/apache/spark/pull/14615 make toJSON not go through rdd form but operate on dataset always ## What changes were proposed in this pull request? Don't convert toRdd when doing toJSON ## How was this

[GitHub] spark issue #14609: [MINOR][Core] fix warnings on depreciated methods in Mes...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14609 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14571: [SPARK-16983][SQL] Add `prettyName` for row_number, dens...

2016-08-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14571 I see. Then, I'll include only that today. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #12930: [SPARK-15153] [ML] [SparkR] Fix SparkR spark.naiveBayes ...

2016-08-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/12930 Do we still need this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-11 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/14546 @dongjoon-hyun The exception was muted by line: https://github.com/apache/spark/pull/14546/files#diff-57b3d87be744b7d79a9beacf8e5e5eb2R1257 If you add some log message, you wils find

[GitHub] spark issue #14586: [SPARK-17003] [BUILD] [BRANCH-1.6] release-build.sh is m...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14586 **[Test build #3222 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3222/consoleFull)** for PR 14586 at commit

[GitHub] spark issue #14611: [SPARK-17028][Repl]Backport SI-9734 for Scala 2.10

2016-08-11 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14611 Closing this one. Just found another issue with the current implementation and will reopen in the future --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #14611: [SPARK-17028][Repl]Backport SI-9734 for Scala 2.1...

2016-08-11 Thread zsxwing
Github user zsxwing closed the pull request at: https://github.com/apache/spark/pull/14611 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14397: [SPARK-16771][SQL] WITH clause should not fall into infi...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14397 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63637/ Test PASSed. ---

[GitHub] spark issue #14613: [SPARK-16883][SparkR]:SQL decimal type is not properly c...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14613 **[Test build #63648 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63648/consoleFull)** for PR 14613 at commit

[GitHub] spark issue #14586: [SPARK-17003] [BUILD] [BRANCH-1.6] release-build.sh is m...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14586 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14614: [SPARK-17027][ML] Avoid integer overflow in PolynomialEx...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14614 **[Test build #63649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63649/consoleFull)** for PR 14614 at commit

[GitHub] spark pull request #14613: [SPARK-16883][SparkR]:SQL decimal type is not pro...

2016-08-11 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/14613 [SPARK-16883][SparkR]:SQL decimal type is not properly cast to number when collecting SparkDataFrame ## What changes were proposed in this pull request? (Please fill in changes

[GitHub] spark pull request #14614: [SPARK-17027][ML] Avoid integer overflow in Polyn...

2016-08-11 Thread zero323
GitHub user zero323 opened a pull request: https://github.com/apache/spark/pull/14614 [SPARK-17027][ML] Avoid integer overflow in PolynomialExpansion.getPolySize ## What changes were proposed in this pull request? Replaces custom choose function with

[GitHub] spark issue #14571: [SPARK-16983][SQL] Add `prettyName` for row_number, dens...

2016-08-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14571 Oh, I think you are working on that transition somewhere else. BTW, what about other tests? If you have a plan to enrich SQLQueryTestSuite, I prefer to do all of them in a single PR during

[GitHub] spark issue #14586: [SPARK-17003] [BUILD] [BRANCH-1.6] release-build.sh is m...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14586 **[Test build #63647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63647/consoleFull)** for PR 14586 at commit

[GitHub] spark issue #14586: [SPARK-17003] [BUILD] [BRANCH-1.6] release-build.sh is m...

2016-08-11 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14586 Done --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14571: [SPARK-16983][SQL] Add `prettyName` for row_number, dens...

2016-08-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14571 Do you think you can create a test file for window functions in the new SQLQueryTestSuite along with this fix? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #14612: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14612 **[Test build #63645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63645/consoleFull)** for PR 14612 at commit

[GitHub] spark issue #14607: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE (follow-up)

2016-08-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14607 **[Test build #63646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63646/consoleFull)** for PR 14607 at commit

[GitHub] spark issue #14607: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE (follow-up)

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14607 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63636/ Test PASSed. ---

[GitHub] spark issue #14607: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE (follow-up)

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14607 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13146 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13146 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63632/ Test PASSed. ---

  1   2   3   4   5   6   >