[GitHub] spark pull request: [SPARK-8531] [ML] Update ML user guide for Min...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7211#issuecomment-134419245 [Test build #41489 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41489/console) for PR 7211 at commit

[GitHub] spark pull request: [SPARK-10198][SQL] Turn off partition verifica...

2015-08-24 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/8404 [SPARK-10198][SQL] Turn off partition verification by default You can merge this pull request into a Git repository by running: $ git pull https://github.com/marmbrus/spark

[GitHub] spark pull request: [SPARK-6723] [MLLIB] Model import/export for C...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/6785#issuecomment-134419255 Can you fix merge conflicts so I can try it out? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-10198][SQL] Turn off partition verifica...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8404#issuecomment-134423019 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10210] [STREAMING] Filter out non-exist...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8405#issuecomment-134427038 [Test build #41495 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41495/console) for PR 8405 at commit

[GitHub] spark pull request: [SPARK-10210] [STREAMING] Filter out non-exist...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8405#issuecomment-134427045 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10004] [shuffle] Perform auth checks wh...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8218#issuecomment-134427069 [Test build #41481 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41481/console) for PR 8218 at commit

[GitHub] spark pull request: [SPARK-10004] [shuffle] Perform auth checks wh...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8218#issuecomment-134427109 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SQL][MINOR][Doc] Clarify docs for inferring D...

2015-08-24 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/8406#issuecomment-134427284 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request: [SPARK-10197] [SQL] Add null check in wrapperF...

2015-08-24 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/8407 [SPARK-10197] [SQL] Add null check in wrapperFor (inside HiveInspectors). https://issues.apache.org/jira/browse/SPARK-10197 You can merge this pull request into a Git repository by running: $

[GitHub] spark pull request: [SPARK-10210] [STREAMING] Filter out non-exist...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8405#issuecomment-134427640 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10178][SQL] HiveComparisionTest should ...

2015-08-24 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/8388#discussion_r37824305 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveComparisonTest.scala --- @@ -386,11 +388,46 @@ abstract class HiveComparisonTest

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r37824256 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingLinearAlgorithm.scala --- @@ -84,7 +87,20 @@ abstract class

[GitHub] spark pull request: [SPARK-10178][SQL] HiveComparisionTest should ...

2015-08-24 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/8388#discussion_r37824244 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveComparisonTest.scala --- @@ -386,11 +388,46 @@ abstract class HiveComparisonTest

[GitHub] spark pull request: [SPARK-10196] [SQL] Correctly saving decimals ...

2015-08-24 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/8408 [SPARK-10196] [SQL] Correctly saving decimals in internal rows to JSON. https://issues.apache.org/jira/browse/SPARK-10196 You can merge this pull request into a Git repository by running: $ git

[GitHub] spark pull request: [SPARK-10137][Streaming]Avoid to restart recei...

2015-08-24 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/8340#discussion_r37824671 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -484,7 +528,10 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: [SPARK-10137][Streaming]Avoid to restart recei...

2015-08-24 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/8340#discussion_r37824644 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -426,12 +440,24 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: [SPARK-10048][SPARKR] Support arbitrary nested...

2015-08-24 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/8276#issuecomment-134443211 The test passed on my machine, I don't know the reason. Anyway, add spark context initialization into test_Serde to see if it can pass on Jenkins. --- If your project

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/8007#discussion_r37826799 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -202,8 +209,17 @@ case class TaskCommitDenied(jobID: Int, partitionID: Int,

[GitHub] spark pull request: [SPARK-10004] [shuffle] Perform auth checks wh...

2015-08-24 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8218#issuecomment-134396675 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-3181][MLLIB]: Add Robust Regression Alg...

2015-08-24 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/8013#discussion_r37813263 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -645,3 +666,179 @@ private class LeastSquaresCostFun(

[GitHub] spark pull request: [SPARK-10165][SQL] Await child resolution in R...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8371#issuecomment-134400384 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10165][SQL] Await child resolution in R...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8371#issuecomment-134400416 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10061] [DOC] ML ensemble docs

2015-08-24 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8369#issuecomment-134401679 Merged into master and branch-1.5. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10165][SQL] Await child resolution in R...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8371#issuecomment-134401288 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10165][SQL] Await child resolution in R...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8371#issuecomment-134401289 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8673] [launcher] API and infrastructure...

2015-08-24 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7052#discussion_r37814522 --- Diff: launcher/src/main/java/org/apache/spark/launcher/package-info.java --- @@ -45,5 +45,33 @@ * } * } * /pre + * + * p +

[GitHub] spark pull request: [SPARK-10118][SparkR][Docs] Improve SparkR API...

2015-08-24 Thread yu-iskw
Github user yu-iskw commented on the pull request: https://github.com/apache/spark/pull/8386#issuecomment-134404067 @shivaram it seems that we can change them with `@name`. I'll try it. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-10195] [SQL] Data sources Filter should...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8403#issuecomment-134404079 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10195] [SQL] Data sources Filter should...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8403#issuecomment-134404076 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8673] [launcher] API and infrastructure...

2015-08-24 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7052#discussion_r37815450 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala --- @@ -101,6 +106,37 @@ class YarnClusterSuite extends BaseYarnClusterSuite

[GitHub] spark pull request: [SPARK-10192] [core] simple test w/ failure in...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8402#issuecomment-134407802 [Test build #41487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41487/consoleFull) for PR 8402 at commit

[GitHub] spark pull request: [SPARK-10016][ML]Stored broadcast var in a pri...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8233#discussion_r37817174 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/Word2Vec.scala --- @@ -194,16 +197,19 @@ class Word2VecModel private[ml] ( */

[GitHub] spark pull request: [SPARK-10118][SparkR][Docs] Improve SparkR API...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8386#issuecomment-134410817 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10048][SPARKR] Support arbitrary nested...

2015-08-24 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8276#issuecomment-134413057 @sun-rui looks like the test failures are related to this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-8531] [ML] Update ML user guide for Min...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7211#issuecomment-134419331 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10198][SQL] Turn off partition verifica...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8404#issuecomment-134419492 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10198][SQL] Turn off partition verifica...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8404#issuecomment-134419504 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10118][SparkR][Docs] Improve SparkR API...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8386#issuecomment-134424042 [Test build #41494 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41494/consoleFull) for PR 8386 at commit

[GitHub] spark pull request: [SQL][MINOR][Doc] Clarify docs for inferring D...

2015-08-24 Thread feynmanliang
GitHub user feynmanliang opened a pull request: https://github.com/apache/spark/pull/8406 [SQL][MINOR][Doc] Clarify docs for inferring DataFrame from RDD of Products * Makes `SQLImplicits.rddToDataFrameHolder` scaladoc consistent with `SQLContext.createDataFrame[A : Product](rdd:

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134434324 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread mccheah
Github user mccheah commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134434393 Ok, I think I've addressed all the comments sans the tasks will be submitted to dead executors temporarily one. Still largely untested. Will be testing now, but pushing

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r37823963 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,57 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r37823899 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,57 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r37823826 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingDecay.scala --- @@ -0,0 +1,57 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134436156 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10118][SparkR][Docs] Improve SparkR API...

2015-08-24 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8386#issuecomment-134436064 Thanks @yu-iskw -- LGTM. Merging this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134438936 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10137][Streaming]Avoid to restart recei...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8340#issuecomment-134438772 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10137][Streaming]Avoid to restart recei...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8340#issuecomment-134438728 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134438941 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10178][SQL] HiveComparisionTest should ...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8388#issuecomment-134442028 [Test build #41503 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41503/consoleFull) for PR 8388 at commit

[GitHub] spark pull request: [SPARK-10048][SPARKR] Support arbitrary nested...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8276#issuecomment-134443896 [Test build #41504 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41504/consoleFull) for PR 8276 at commit

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread mccheah
Github user mccheah commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134443864 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10177] [SQL] fix reading Timestamp in p...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8400#issuecomment-134448764 [Test build #1688 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1688/console) for PR 8400 at commit

[GitHub] spark pull request: [SPARK-9525] [PySpark] [MLlib] Optimize Sparse...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/7854#discussion_r37826282 --- Diff: python/pyspark/mllib/linalg/__init__.py --- @@ -461,32 +461,41 @@ def __init__(self, size, *args): self.size = int(size)

[GitHub] spark pull request: [SPARK-10210] [STREAMING] Filter out non-exist...

2015-08-24 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/8405#discussion_r37826314 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/ReceiverInputDStream.scala --- @@ -116,7 +116,10 @@ abstract class

[GitHub] spark pull request: [SPARK-9730][SQL] Add Full Outer Join support ...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8383#issuecomment-134449037 **[Test build #41488 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41488/console)** for PR 8383 at commit

[GitHub] spark pull request: [SPARK-10020][MLlib]: ML model broadcasts shou...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8249#issuecomment-134410167 @sabhyankar looks good overall: * Do you mind resolving merge conflicts? * Can you put #8248 #8247 #8243 and #8249 all in one PR and close the others

[GitHub] spark pull request: [SPARK-10190] Fix NPE in CatalystTypeConverter...

2015-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8401 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10176][SQL][WIP] Show partially analyze...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8389#issuecomment-134415673 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10195] [SQL] Data sources Filter should...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8403#issuecomment-134415771 [Test build #41490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41490/consoleFull) for PR 8403 at commit

[GitHub] spark pull request: [SPARK-10198][SQL] Turn off partition verifica...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8404#issuecomment-134423027 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10165][SQL] Await child resolution in R...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8371#issuecomment-134425052 [Test build #41483 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41483/console) for PR 8371 at commit

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134429529 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10197] [SQL] Add null check in wrapperF...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8407#issuecomment-134429907 [Test build #41498 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41498/consoleFull) for PR 8407 at commit

[GitHub] spark pull request: [SPARK-10210] [STREAMING] Filter out non-exist...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8405#issuecomment-134429574 [Test build #41497 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41497/consoleFull) for PR 8405 at commit

[GitHub] spark pull request: [SPARK-4980] [MLlib] Add decay factors to stre...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/8022#discussion_r37824112 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingLinearAlgorithm.scala --- @@ -84,7 +87,20 @@ abstract class

[GitHub] spark pull request: [SPARK-10137][Streaming]Avoid to restart recei...

2015-08-24 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/8340#discussion_r37824577 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -244,24 +244,38 @@ class ReceiverTracker(ssc:

[GitHub] spark pull request: [SPARK-10178][SQL] HiveComparisionTest should ...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8388#issuecomment-134440529 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8971][MLLIB][ML] Support balanced class...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8112#issuecomment-134440591 @mengxr is probably the best person for reviewing the use of ScaSRS ;) --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-10210] [STREAMING] Filter out non-exist...

2015-08-24 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/8405#discussion_r37827033 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/ReceiverInputDStream.scala --- @@ -116,7 +116,10 @@ abstract class

[GitHub] spark pull request: [SPARK-9525] [PySpark] [MLlib] Optimize Sparse...

2015-08-24 Thread MechCoder
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/7854#discussion_r37826909 --- Diff: python/pyspark/mllib/linalg/__init__.py --- @@ -461,32 +461,41 @@ def __init__(self, size, *args): self.size = int(size)

[GitHub] spark pull request: [SPARK-10118][SparkR][Docs] Improve SparkR API...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8386#issuecomment-134406683 [Test build #41485 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41485/consoleFull) for PR 8386 at commit

[GitHub] spark pull request: [SPARK-10015][MLlib]: ML model broadcasts shou...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8243#issuecomment-134410441 Can you close this and include changes with #8249 ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-10018][MLlib]: ML model broadcasts shou...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8247#issuecomment-134410434 Can you close this and include changes with #8249 ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-10019][MLlib]: ML model broadcasts shou...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/8248#issuecomment-134410452 Can you close this and include changes with #8249 ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-10195] [SQL] Data sources Filter should...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8403#issuecomment-134415366 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10195] [SQL] Data sources Filter should...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8403#issuecomment-134415375 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9284] [tests] Allow all tests to run wi...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7629#issuecomment-134422481 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9284] [tests] Allow all tests to run wi...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7629#issuecomment-134422493 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10118][SparkR][Docs] Improve SparkR API...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8386#issuecomment-134423703 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10118][SparkR][Docs] Improve SparkR API...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8386#issuecomment-134423720 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10004] [shuffle] Perform auth checks wh...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8218#issuecomment-134427108 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10210] [STREAMING] Filter out non-exist...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8405#issuecomment-134427041 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10197] [SQL] Add null check in wrapperF...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8407#issuecomment-134428428 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134429237 **[Test build #41478 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41478/console)** for PR 8007 at commit

[GitHub] spark pull request: [SPARK-3533][Core] Add saveAsTextFileByKey() m...

2015-08-24 Thread n-my
Github user n-my commented on the pull request: https://github.com/apache/spark/pull/8375#issuecomment-134429446 Can't wait for that to be released :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134429526 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9560][MLlib] add lda data generator

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/7898#issuecomment-134433552 Thanks! Have you tried running LDA on the generated data? What were the results? I think @jkbradley meant for this to be contributed to `spark-perf` and

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134434994 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134434987 [Test build #41499 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41499/console) for PR 8007 at commit

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134434760 [Test build #41499 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41499/consoleFull) for PR 8007 at commit

[GitHub] spark pull request: [SPARK-10178][SQL] HiveComparisionTest should ...

2015-08-24 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/8388#discussion_r37824297 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveComparisonTest.scala --- @@ -386,11 +388,46 @@ abstract class HiveComparisonTest

[GitHub] spark pull request: [SPARK-10178][SQL] HiveComparisionTest should ...

2015-08-24 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/8388#discussion_r37824326 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveComparisonTest.scala --- @@ -386,11 +388,46 @@ abstract class HiveComparisonTest

[GitHub] spark pull request: [SPARK-10178][SQL] HiveComparisionTest should ...

2015-08-24 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8388#issuecomment-134437140 LGTM overall, modulo a few minor nits. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9525] [PySpark] [MLlib] Optimize Sparse...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/7854#discussion_r37825181 --- Diff: python/pyspark/mllib/linalg/__init__.py --- @@ -461,32 +461,41 @@ def __init__(self, size, *args): self.size = int(size)

[GitHub] spark pull request: [SPARK-8167] Make tasks that fail from YARN pr...

2015-08-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8007#issuecomment-134442777 **[Test build #41484 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41484/console)** for PR 8007 at commit

[GitHub] spark pull request: [SPARK-9525] [PySpark] [MLlib] Optimize Sparse...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/7854#discussion_r37825155 --- Diff: python/pyspark/mllib/linalg/__init__.py --- @@ -461,32 +461,41 @@ def __init__(self, size, *args): self.size = int(size)

[GitHub] spark pull request: [SPARK-9525] [PySpark] [MLlib] Optimize Sparse...

2015-08-24 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/7854#discussion_r37825834 --- Diff: python/pyspark/mllib/linalg/__init__.py --- @@ -461,32 +461,41 @@ def __init__(self, size, *args): self.size = int(size)

<    1   2   3   4   5   6   7   8   >