[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144635483 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144635481 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144635427 [Test build #43145 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43145/console) for PR 8926 at commit [`4f1e8a9`](https://github.

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144633364 [Test build #43145 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43145/consoleFull) for PR 8926 at commit [`4f1e8a9`](https://gith

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144632683 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144632695 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread vectorijk
Github user vectorijk commented on a diff in the pull request: https://github.com/apache/spark/pull/8926#discussion_r40882471 --- Diff: python/pyspark/ml/regression.py --- @@ -609,6 +611,147 @@ class GBTRegressionModel(TreeEnsembleModels): """ +@inherit_doc

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144632133 And we did support that sort function for dataframe because we couldn't have it for columns. I cannot add it to SparkR columns either ... --- If your project is set up

[GitHub] spark pull request: [WIP][SPARK-10891][STREAMING][KINESIS] Add Mes...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8954#issuecomment-144629404 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [WIP][SPARK-10891][STREAMING][KINESIS] Add Mes...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8954#issuecomment-144629399 [Test build #43144 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43144/console) for PR 8954 at commit [`40c92b3`](https://github.

[GitHub] spark pull request: [WIP][SPARK-10891][STREAMING][KINESIS] Add Mes...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8954#issuecomment-144629405 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [WIP][SPARK-10891][STREAMING][KINESIS] Add Mes...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8954#issuecomment-144629213 [Test build #43144 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43144/consoleFull) for PR 8954 at commit [`40c92b3`](https://gith

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144629036 okay, our customers had that sort for dataframes too but it seems that R doesn't have it for dataframe. Now let's decide what do we want to do. we can have t

[GitHub] spark pull request: [WIP][SPARK-10891][STREAMING][KINESIS] Add Mes...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8954#issuecomment-144628691 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [WIP][SPARK-10891][STREAMING][KINESIS] Add Mes...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8954#issuecomment-144628701 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10891][STREAMING][KINESIS] Add MessageH...

2015-09-30 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/8954 [SPARK-10891][STREAMING][KINESIS] Add MessageHandler to KinesisUtils.createStream similar to Direct Kafka This PR allows users to map a Kinesis `Record` to a generic `T` when creating a Kinesis stre

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144627139 I cannot understand one thing why are we supporting string column types here: setMethod("arrange", signature(x = "DataFrame", col = "characterOrColumn")

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144627088 order is for vectors: http://www.inside-r.org/r-doc/base/order --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144626919 I think `arrange` does work with both column name strings or Column: ``` setMethod("arrange", signature(x = "DataFrame", col = "characterOrColumn

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8926#discussion_r40880325 --- Diff: python/pyspark/ml/regression.py --- @@ -609,6 +611,147 @@ class GBTRegressionModel(TreeEnsembleModels): """ +@inherit_doc

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144623226 okay, I see. For columns we probably cannot add sort right now because the dataframe api doesn't have it. For my understanding arrange isn't doing sorting for string

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144621929 I think @sun-rui does have a point here. Generally in R, `sort` is for list & vector https://stat.ethz.ch/R-manual/R-devel/library/base/html/sort.html Bu

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144619340 Hi sun-rui, I'll do the correction with param. I'm not sure what do you mean with coding style issues for dontrun {}. I did it exactly as arrange and added exampl

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144615116 My concern is still the name. Maybe we can make it combine with arrange(). @NarineK, could you update the function description more accurate (param), also coding

[GitHub] spark pull request: [SPARK-10058][Core][Tests]Fix the flaky tests ...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8946#issuecomment-144614101 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10058][Core][Tests]Fix the flaky tests ...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8946#issuecomment-144614100 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10058][Core][Tests]Fix the flaky tests ...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8946#issuecomment-144614039 [Test build #43143 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43143/console) for PR 8946 at commit [`0debc46`](https://github.

[GitHub] spark pull request: [SPARK-10671] [SQL] Throws an analysis excepti...

2015-09-30 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8941#discussion_r40877302 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala --- @@ -60,20 +60,36 @@ private[hive] class HiveFunctionRegistry(underlying: analysi

[GitHub] spark pull request: [SPARK-10671] [SQL] Throws an analysis excepti...

2015-09-30 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8941#discussion_r40877292 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala --- @@ -299,6 +300,42 @@ class HiveUDFSuite extends QueryTest with Te

[GitHub] spark pull request: [SPARK-10317] [Core] Compatibility between his...

2015-09-30 Thread rekhajoshm
Github user rekhajoshm commented on the pull request: https://github.com/apache/spark/pull/8758#issuecomment-144604656 Thanks for your comments @vanzin ! However that does not seem an accurate assessment.Before this patch, the script accepted only first parameter and set it to logD

[GitHub] spark pull request: [SPARK-8542][MLlib]PMML export for Decision Tr...

2015-09-30 Thread JasmineGeorge
Github user JasmineGeorge commented on the pull request: https://github.com/apache/spark/pull/7842#issuecomment-144599967 Thanks a lot @selvinsource. @mengxr is there anything we should be adding/changing ? Please let me know. Once these changes are merged I will start with the

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144599664 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144599666 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144599640 [Test build #43141 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43141/console) for PR 8909 at commit [`bcaddb3`](https://github.

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144593792 Could you please add test for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/8952#discussion_r40873300 --- Diff: R/pkg/R/SQLContext.R --- @@ -149,6 +149,26 @@ createDataFrame <- function(sqlContext, data, schema = NULL, samplingRatio = 1.0 dataFrame(

[GitHub] spark pull request: [SPARK-10058][Core][Tests]Fix the flaky tests ...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8946#issuecomment-144590641 [Test build #43143 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43143/consoleFull) for PR 8946 at commit [`0debc46`](https://gith

[GitHub] spark pull request: [SPARK-10887] [sql] Build HashedRelation outsi...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-144590367 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10887] [sql] Build HashedRelation outsi...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-144590365 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10887] [sql] Build HashedRelation outsi...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-144590300 [Test build #43140 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43140/console) for PR 8953 at commit [`0cf8d44`](https://github.

[GitHub] spark pull request: [SPARK-10058][Core][Tests]Fix the flaky tests ...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8946#issuecomment-144589998 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10058][Core][Tests]Fix the flaky tests ...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8946#issuecomment-144590006 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10058][Core][Tests]Fix the flaky tests ...

2015-09-30 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/8946#issuecomment-144589673 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144589520 @NarineK Could you also add a unit test for this ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144589084 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144589083 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144589029 [Test build #43142 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43142/console) for PR 8952 at commit [`bfdcd07`](https://github.

[GitHub] spark pull request: [SPARK-10807][SPARKR] Added as.data.frame as a...

2015-09-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8908 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144586677 [Test build #43142 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43142/consoleFull) for PR 8952 at commit [`bfdcd07`](https://gith

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144585918 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144585904 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144585511 Jenkins, add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144585523 Jenkins, ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-10879] spark on yarn support priority o...

2015-09-30 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/8943#issuecomment-144580262 Agreed with undocumented configuration. BTW, my question is that do we need to take care of priority in `ContainerRequest`? Now it is setting by `RM_REQUEST_PR

[GitHub] spark pull request: [SPARK-9818][SQL][WIP]Revert SPARK-6136 to ena...

2015-09-30 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8101#issuecomment-144578314 I'd like to help get this patch merged so that we can re-run these tests, but before we put a lot more work into polishing it I would like to figure out whether our re

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144578203 [Test build #43141 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43141/consoleFull) for PR 8909 at commit [`bcaddb3`](https://gith

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144577473 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144577494 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10300] [build] [tests] Add support for ...

2015-09-30 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8437#issuecomment-144576174 Are there plans to revive this PR and attempt another merge? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144574754 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144574752 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144574661 [Test build #43139 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43139/console) for PR 8926 at commit [`25ac136`](https://github.

[GitHub] spark pull request: [SPARK-10887] [sql] Build HashedRelation outsi...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-144574443 [Test build #43140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43140/consoleFull) for PR 8953 at commit [`0cf8d44`](https://gith

[GitHub] spark pull request: [SPARK-10887] [sql] Build HashedRelation outsi...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-144573079 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10887] [sql] Build HashedRelation outsi...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-144573095 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10887] [sql] Build HashedRelation outsi...

2015-09-30 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/8953 [SPARK-10887] [sql] Build HashedRelation outside of HashJoinNode. This PR refactors `HashJoinNode` to take a existing `HashedRelation`. So, we can reuse this node for both `ShuffledHashJoin` and `Broa

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144572149 [Test build #43139 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43139/consoleFull) for PR 8926 at commit [`25ac136`](https://gith

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144571043 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8926#issuecomment-144571025 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10886] [Documentation] Random RDD creat...

2015-09-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/8951#discussion_r40864312 --- Diff: docs/mllib-statistics.md --- @@ -542,7 +542,7 @@ JavaSparkContext jsc = ... // Generate a random double RDD that contains 1 million i.i.d.

[GitHub] spark pull request: [SPARK-10886] [Documentation] Random RDD creat...

2015-09-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/8951#discussion_r40864280 --- Diff: docs/mllib-statistics.md --- @@ -521,7 +521,7 @@ val sc: SparkContext = ... // Generate a random double RDD that contains 1 million i.i.d.

[GitHub] spark pull request: [SPARK-10688][ML][PySpark] Python API for AFTS...

2015-09-30 Thread vectorijk
Github user vectorijk commented on a diff in the pull request: https://github.com/apache/spark/pull/8926#discussion_r40864215 --- Diff: python/pyspark/ml/regression.py --- @@ -609,6 +611,150 @@ class GBTRegressionModel(TreeEnsembleModels): """ +@inherit_doc

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144568839 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144568840 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144568767 [Test build #43137 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43137/console) for PR 8909 at commit [`e942e93`](https://github.

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7946 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/7946#issuecomment-144564156 Thank you @NathanHowell. LGTM. Merging to master. If you have time, can you create a follow-up PR for calling `parser.close` in `GetJsonObject`? --- If your pro

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7946#issuecomment-144561243 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7946#issuecomment-144561245 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7946#issuecomment-144561129 [Test build #43138 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43138/console) for PR 7946 at commit [`1b91746`](https://github.

[GitHub] spark pull request: SPARK-7021 Add JUnit output for Python tests

2015-09-30 Thread gliptak
Github user gliptak commented on the pull request: https://github.com/apache/spark/pull/8323#issuecomment-144553667 @mengxr Thank you for guiding this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SPARK-10888] [SparkR] Added as.DataFrame as a...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8952#issuecomment-144550641 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-10888] [SparkR] Adding as.DataFrame as ...

2015-09-30 Thread NarineK
GitHub user NarineK opened a pull request: https://github.com/apache/spark/pull/8952 [SPARK-10888] [SparkR] Adding as.DataFrame as a synonym to createDataFrame as.DataFrame is more a R-style like signature. Also, I'd like to know if we could make the context, e.g. sqlContext glo

[GitHub] spark pull request: [SPARK-10807][SPARKR] Added as.data.frame as a...

2015-09-30 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8908#issuecomment-144544005 Thanks @olarayej LGTM. Merging this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144543047 @sun-rui Could you take one more look ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10648] Proposed bug fix when oracle ret...

2015-09-30 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8780#issuecomment-144541760 I met this problem before, and actually it's not spark that detect them to be 0 and -127, but JDBC. My solution is just adding a `OracleDialect` to handle this sepcial

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7946#issuecomment-144533174 [Test build #43138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43138/consoleFull) for PR 7946 at commit [`1b91746`](https://gith

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144532879 [Test build #43137 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43137/consoleFull) for PR 8909 at commit [`e942e93`](https://gith

[GitHub] spark pull request: [SPARK-10886] [Documentation] Random RDD creat...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8951#issuecomment-144531931 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread NathanHowell
Github user NathanHowell commented on a diff in the pull request: https://github.com/apache/spark/pull/7946#discussion_r40846432 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonFunctions.scala --- @@ -307,3 +308,140 @@ case class GetJsonObject(j

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144529838 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread NathanHowell
Github user NathanHowell commented on the pull request: https://github.com/apache/spark/pull/7946#issuecomment-144529990 Alright, I think I've addressed all your comments @yhuai. I haven't run the tests though :-) --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144529764 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10886] [Documentation] Random RDD creat...

2015-09-30 Thread jayantshekhar
GitHub user jayantshekhar opened a pull request: https://github.com/apache/spark/pull/8951 [SPARK-10886] [Documentation] Random RDD creation example fix in MLlib statistics programming guide - mllib-statistics.md Fixed it to RandomRDDs.normalJavaRDD You can merge this pull request

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7946#issuecomment-144529839 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9617] [SQL] Implement json_tuple

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7946#issuecomment-144529777 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144525589 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144525594 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10810] [WIP] [SQL] Improve session mana...

2015-09-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8909#issuecomment-144525512 [Test build #43135 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43135/console) for PR 8909 at commit [`5160fea`](https://github.

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-09-30 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-144525188 Thanks! Would you mind, please, assigning the corresponding jira to me and resolving it ? --- If your project is set up for it, you can reply to this email and have you

  1   2   3   >