[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/5645#discussion_r29026826 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala --- @@ -96,9 +99,27 @@ class WriteAheadLogBackedBlockRD

[GitHub] spark pull request: [SPARK-6891] Fix the bug that ExecutorAllocati...

2015-04-23 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/5676#issuecomment-95822131 This looks like a duplicate of SPARK-6954 (PR #5536) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3468][WebUI] Timeline-View feature

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2342#issuecomment-95821459 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-3468][WebUI] Timeline-View feature

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2342#issuecomment-95821427 [Test build #30916 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30916/consoleFull) for PR 2342 at commit [`d3c63c8`](https://gith

[GitHub] spark pull request: [SPARK-6122][Core] Upgrade tachyon-client vers...

2015-04-23 Thread aniketbhatnagar
Github user aniketbhatnagar commented on the pull request: https://github.com/apache/spark/pull/5354#issuecomment-95819955 +1 from my side. having a consistent httpclient version would be so much better! --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-7112][Streaming] Add a DirectStreamTrac...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5680#issuecomment-95819308 [Test build #30920 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30920/consoleFull) for PR 5680 at commit [`28d668f`](https://githu

[GitHub] spark pull request: [SPARK-7112][Streaming] Add a DirectStreamTrac...

2015-04-23 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/5680 [SPARK-7112][Streaming] Add a DirectStreamTracker to track the direct streams You can merge this pull request into a Git repository by running: $ git pull https://github.com/jerryshao/apach

[GitHub] spark pull request: [SPARK-7097][SQL]: Partitioned tables should o...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5668#issuecomment-95817298 [Test build #30919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30919/consoleFull) for PR 5668 at commit [`b4651fd`](https://githu

[GitHub] spark pull request: [SPARK-3468][WebUI] Timeline-View feature

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2342#issuecomment-95813823 [Test build #30918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30918/consoleFull) for PR 2342 at commit [`b09d0c5`](https://githu

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5645#issuecomment-95811201 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5645#issuecomment-95811180 [Test build #30914 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30914/consoleFull) for PR 5645 at commit [`d7cd15b`](https://gith

[GitHub] spark pull request: SPARK-7103: Fix crash with SparkContext.union ...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5679#issuecomment-95810737 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: SPARK-7103: Fix crash with SparkContext.union ...

2015-04-23 Thread stevencanopy
GitHub user stevencanopy opened a pull request: https://github.com/apache/spark/pull/5679 SPARK-7103: Fix crash with SparkContext.union when RDD has no partitioner Added a check to the SparkContext.union method to check that a partitioner is defined on all RDDs when instantiating a

[GitHub] spark pull request: [SPARK-5894][ML] Add polynomial mapper

2015-04-23 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/5245#issuecomment-95810160 @mengxr I do some tests on these two versions, here is the result log: (You can see my code [here](https://github.com/yinxusen/spark/blob/PerformanceTest-5894/mllib/src/

[GitHub] spark pull request: [SPARK-1442][SQL][WIP] Window Function Support...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5604#issuecomment-95809888 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-1442][SQL][WIP] Window Function Support...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5604#issuecomment-95809882 [Test build #30917 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30917/consoleFull) for PR 5604 at commit [`5b96e2a`](https://gith

[GitHub] spark pull request: [SPARK-1442][SQL][WIP] Window Function Support...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5604#issuecomment-95809470 [Test build #30917 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30917/consoleFull) for PR 5604 at commit [`5b96e2a`](https://githu

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/5626#issuecomment-95806853 LGTM except some minor inline comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024766 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/GBTExample.scala --- @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024771 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/RandomForestRegressor.scala --- @@ -0,0 +1,167 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024769 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/DecisionTreeClassifier.scala --- @@ -85,18 +82,16 @@ final class DecisionTreeClassifier

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024757 --- Diff: mllib/src/test/java/org/apache/spark/ml/classification/JavaGBTClassifierSuite.java --- @@ -0,0 +1,100 @@ +/* + * Licensed to the Apache Soft

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024748 --- Diff: mllib/src/main/scala/org/apache/spark/ml/impl/tree/treeParams.scala --- @@ -296,5 +299,194 @@ private[ml] trait TreeRegressorParams extends Params {

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024762 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/RandomForestClassifierSuite.scala --- @@ -0,0 +1,165 @@ +/* + * Licensed to the Apac

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024737 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/GBTClassifier.scala --- @@ -0,0 +1,226 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024743 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/RandomForestClassifier.scala --- @@ -0,0 +1,184 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5645#issuecomment-95806380 [Test build #30913 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30913/consoleFull) for PR 5645 at commit [`1a32a4b`](https://gith

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024756 --- Diff: mllib/src/test/java/org/apache/spark/ml/classification/JavaGBTClassifierSuite.java --- @@ -0,0 +1,100 @@ +/* + * Licensed to the Apache Soft

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024746 --- Diff: mllib/src/main/scala/org/apache/spark/ml/impl/tree/treeParams.scala --- @@ -296,5 +299,194 @@ private[ml] trait TreeRegressorParams extends Params {

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5645#issuecomment-95806388 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024741 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/RandomForestClassifier.scala --- @@ -0,0 +1,184 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request: [SQL] Fixed expression data type matching.

2015-04-23 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5675#discussion_r29024715 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/DataType.scala --- @@ -40,32 +40,46 @@ import org.apache.spark.util.Utils */ @Develop

[GitHub] spark pull request: [SPARK-3468][WebUI] Timeline-View feature

2015-04-23 Thread sarutak
Github user sarutak commented on a diff in the pull request: https://github.com/apache/spark/pull/2342#discussion_r29024688 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala --- @@ -17,17 +17,172 @@ package org.apache.spark.ui.jobs -import

[GitHub] spark pull request: [SPARK-7109] [SQL] Push down left side filter ...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5677#issuecomment-95805563 [Test build #30911 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30911/consoleFull) for PR 5677 at commit [`ebadaa9`](https://gith

[GitHub] spark pull request: [SPARK-7109] [SQL] Push down left side filter ...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5677#issuecomment-95805571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SQL] Fixed expression data type matching.

2015-04-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/5675#discussion_r29024422 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/DataType.scala --- @@ -40,32 +40,46 @@ import org.apache.spark.util.Utils */ @De

[GitHub] spark pull request: [SPARK-7103][Spark Core]Verify patitionors are...

2015-04-23 Thread vinodkc
GitHub user vinodkc opened a pull request: https://github.com/apache/spark/pull/5678 [SPARK-7103][Spark Core]Verify patitionors are available in all RDDs used in PartitionerAwareUnionRDD You can merge this pull request into a Git repository by running: $ git pull https://git

[GitHub] spark pull request: [SPARK-7103][Spark Core]Verify patitionors are...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5678#issuecomment-95805275 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-6612] [MLLib] [PySpark] Python KMeans p...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5647#issuecomment-95805052 [Test build #30912 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30912/consoleFull) for PR 5647 at commit [`9903837`](https://gith

[GitHub] spark pull request: [SPARK-5687][Core]TaskResultGetter needs to ca...

2015-04-23 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/4474#issuecomment-95805067 I'd be happy to have a patch that kills the JVM when this occurs, with a warning message logged. I didn't realize in your original submission that this was actually just

[GitHub] spark pull request: [SPARK-6612] [MLLib] [PySpark] Python KMeans p...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5647#issuecomment-95805062 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-7026] [SQL] fix left semi join with equ...

2015-04-23 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/5643#discussion_r29024298 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastLeftSemiJoinHash.scala --- @@ -32,36 +32,69 @@ case class BroadcastLef

[GitHub] spark pull request: [SPARK-7093][SQL] Using newPredicate in Nested...

2015-04-23 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/5665#issuecomment-95804784 `newPredicate(condition.getOrElse(Literal(true)), left.output ++ right.output)`? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-3468][WebUI] Timeline-View feature

2015-04-23 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/2342#discussion_r29024275 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala --- @@ -17,17 +17,172 @@ package org.apache.spark.ui.jobs -impor

[GitHub] spark pull request: [SPARK-7009] repackaging spark assembly jar wi...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5637#issuecomment-95804369 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-7009] repackaging spark assembly jar wi...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5637#issuecomment-95804360 [Test build #30906 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30906/consoleFull) for PR 5637 at commit [`ab38c71`](https://gith

[GitHub] spark pull request: [SPARK-3468][WebUI] Timeline-View feature

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2342#issuecomment-95803737 [Test build #30916 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30916/consoleFull) for PR 2342 at commit [`d3c63c8`](https://githu

[GitHub] spark pull request: [SPARK-6113] [ml] Tree ensembles for Pipelines...

2015-04-23 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/5626#discussion_r29024038 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/GBTClassifier.scala --- @@ -0,0 +1,225 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark pull request: [SPARK-7026] [SQL] fix left semi join with equ...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5643#issuecomment-95800072 [Test build #30905 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30905/consoleFull) for PR 5643 at commit [`d29f9a6`](https://gith

[GitHub] spark pull request: [SPARK-7026] [SQL] fix left semi join with equ...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5643#issuecomment-95800074 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6852][SPARKR] Accept numeric as numPart...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5613#issuecomment-95799955 [Test build #30907 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30907/consoleFull) for PR 5613 at commit [`abaf02e`](https://gith

[GitHub] spark pull request: [SPARK-6852][SPARKR] Accept numeric as numPart...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5613#issuecomment-95799978 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-5213] [SQL] Pluggable SQL Parser Suppor...

2015-04-23 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/4015#issuecomment-95799659 @marmbrus Any more comment on this before merging? It will be great appreciated if you merge this soon, as I did take lots of time in rebase again and again. :)

[GitHub] spark pull request: [SPARK-6122][Core] Upgrade tachyon-client vers...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5354#issuecomment-95799433 [Test build #30915 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30915/consoleFull) for PR 5354 at commit [`0eefe4d`](https://githu

[GitHub] spark pull request: [SPARK-6122][Core] Upgrade tachyon-client vers...

2015-04-23 Thread calvinjia
Github user calvinjia commented on the pull request: https://github.com/apache/spark/pull/5354#issuecomment-95799161 @srowen I appreciate the feedback, and I've cleaned up the httpclient versions as you suggested. Do you have any other comments? Thanks. --- If your project

[GitHub] spark pull request: [SPARK-7044][SQL] Fix the deadlock in ScriptTr...

2015-04-23 Thread chenghao-intel
Github user chenghao-intel closed the pull request at: https://github.com/apache/spark/pull/5671 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-7044][SQL] Fix the deadlock in ScriptTr...

2015-04-23 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/5671#issuecomment-95798871 Thank you @rxin, closing since it's merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5645#issuecomment-95798479 [Test build #30909 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30909/consoleFull) for PR 5645 at commit [`e0d19fb`](https://gith

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5645#issuecomment-95798495 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5645#issuecomment-95798520 [Test build #30914 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30914/consoleFull) for PR 5645 at commit [`d7cd15b`](https://githu

[GitHub] spark pull request: [SPARK-7084] improve saveAsTable documentation

2015-04-23 Thread phatak-dev
Github user phatak-dev commented on the pull request: https://github.com/apache/spark/pull/5654#issuecomment-95798250 Added for other methods also. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5645#issuecomment-95798234 [Test build #30913 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30913/consoleFull) for PR 5645 at commit [`1a32a4b`](https://githu

[GitHub] spark pull request: [SPARK-6435] spark-shell --jars option does no...

2015-04-23 Thread tsudukim
Github user tsudukim commented on the pull request: https://github.com/apache/spark/pull/5227#issuecomment-95798208 I was checking about the `SparkLauncherSuite` on Windows as vanzin's comment, and faced some trouble. It seems not to related with this PR, but I'm not sure yet. Please

[GitHub] spark pull request: [SPARK-6891] Fix the bug that ExecutorAllocati...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5676#issuecomment-95797914 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6418] Add simple per-stage visualizatio...

2015-04-23 Thread shroffpradyumn
Github user shroffpradyumn commented on the pull request: https://github.com/apache/spark/pull/5547#issuecomment-95797940 Thank you all for your feedback, and I apologize for my late reply (it’s been a rough week of midterms). @pwendell - I’ve addressed all your inline com

[GitHub] spark pull request: [SPARK-6891] Fix the bug that ExecutorAllocati...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5676#issuecomment-95797907 [Test build #30908 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30908/consoleFull) for PR 5676 at commit [`1693b54`](https://gith

[GitHub] spark pull request: [SQL] Fixed expression data type matching.

2015-04-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5675 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-95797532 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-95797525 [Test build #30903 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30903/consoleFull) for PR 5667 at commit [`9d2295e`](https://gith

[GitHub] spark pull request: [SQL] Fixed expression data type matching.

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5675#issuecomment-95797394 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SQL] Fixed expression data type matching.

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5675#issuecomment-95797389 [Test build #30902 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30902/consoleFull) for PR 5675 at commit [`0f31856`](https://gith

[GitHub] spark pull request: [SPARK-7092] Update spark scala version to 2.1...

2015-04-23 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/5662#discussion_r29022546 --- Diff: repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkIMain.scala --- @@ -1129,7 +1129,7 @@ class SparkIMain(@BeanProperty val factory: Scri

[GitHub] spark pull request: [SPARK-7093][SQL] Using newPredicate in Nested...

2015-04-23 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/5665#issuecomment-95792030 /cc @rxin @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-6612] [MLLib] [PySpark] Python KMeans p...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5647#issuecomment-95791867 [Test build #30912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30912/consoleFull) for PR 5647 at commit [`9903837`](https://githu

[GitHub] spark pull request: [SPARK-6612] [MLLib] [PySpark] Python KMeans p...

2015-04-23 Thread FlytxtRnD
Github user FlytxtRnD commented on the pull request: https://github.com/apache/spark/pull/5647#issuecomment-95791587 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-7044][SQL] Fix the deadlock in ScriptTr...

2015-04-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5671#issuecomment-95791377 Can you close the PR? Since it was not merged into master, github won't close this automatically. --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark pull request: Update sql-programming-guide.md

2015-04-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5674 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: Update sql-programming-guide.md

2015-04-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5674#issuecomment-95791355 Thanks. I've merged this in master & branch-1.3. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: [SPARK-7109] [SQL] Push down left side filter ...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5677#issuecomment-95790916 [Test build #30911 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30911/consoleFull) for PR 5677 at commit [`ebadaa9`](https://githu

[GitHub] spark pull request: [SPARK-7033][SPARKR] Clean usage of split. Use...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5628#issuecomment-95789973 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-7109] [SQL] Push down left side filter ...

2015-04-23 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/5677#issuecomment-95789809 i will try to add a test case for this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SPARK-7033][SPARKR] Clean usage of split. Use...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5628#issuecomment-95789945 [Test build #30899 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30899/consoleFull) for PR 5628 at commit [`046bc9e`](https://gith

[GitHub] spark pull request: [SPARK-7109] [SQL] Push down left side filter ...

2015-04-23 Thread scwf
GitHub user scwf opened a pull request: https://github.com/apache/spark/pull/5677 [SPARK-7109] [SQL] Push down left side filter for left semi join Now in spark sql optimizer we only push down right side filter for left semi join, actually we can push down left side filter. You can

[GitHub] spark pull request: [SPARK-6418] Add simple per-stage visualizatio...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5547#issuecomment-95789435 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6418] Add simple per-stage visualizatio...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5547#issuecomment-95789429 [Test build #30910 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30910/consoleFull) for PR 5547 at commit [`5c3a2a6`](https://gith

[GitHub] spark pull request: [SPARK-6418] Add simple per-stage visualizatio...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5547#issuecomment-95789315 [Test build #30910 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30910/consoleFull) for PR 5547 at commit [`5c3a2a6`](https://githu

[GitHub] spark pull request: [SPARK-6924][YARN] Fix driver hangs in yarn-cl...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5663#issuecomment-95789182 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-6924][YARN] Fix driver hangs in yarn-cl...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5663#issuecomment-95789176 [Test build #30898 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30898/consoleFull) for PR 5663 at commit [`cf80049`](https://gith

[GitHub] spark pull request: [SPARK-4233] [SQL] [WIP] UDAF Interface Refact...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5542#issuecomment-95788877 [Test build #30901 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30901/consoleFull) for PR 5542 at commit [`71f1bd5`](https://gith

[GitHub] spark pull request: [SPARK-4233] [SQL] [WIP] UDAF Interface Refact...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5542#issuecomment-9573 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5645#issuecomment-95788717 [Test build #30909 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30909/consoleFull) for PR 5645 at commit [`e0d19fb`](https://githu

[GitHub] spark pull request: [SPARK-6891] Fix the bug that ExecutorAllocati...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5676#issuecomment-95787694 [Test build #30908 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30908/consoleFull) for PR 5676 at commit [`1693b54`](https://githu

[GitHub] spark pull request: [SPARK-7031][ThriftServer]let thrift server ta...

2015-04-23 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the pull request: https://github.com/apache/spark/pull/5609#issuecomment-95787561 BTW I have tested on my cluster with setting >export SPARK_DAEMON_MEMORY=m export SPARK_DAEMON_JAVA_OPTS=" -Dx=y " in spark-env.sh. Before

[GitHub] spark pull request: [SPARK-6891] Fix the bug that ExecutorAllocati...

2015-04-23 Thread ArcherShao
GitHub user ArcherShao opened a pull request: https://github.com/apache/spark/pull/5676 [SPARK-6891] Fix the bug that ExecutorAllocationManager will request negative number executors In ExecutorAllocationManager, executor allocate schedule at a fix rate(100ms), it will call the met

[GitHub] spark pull request: [SPARK-6852][SPARKR] Accept numeric as numPart...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5613#issuecomment-95786756 [Test build #30907 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30907/consoleFull) for PR 5613 at commit [`abaf02e`](https://githu

[GitHub] spark pull request: [SPARK-7009] repackaging spark assembly jar wi...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5637#issuecomment-95786710 [Test build #30906 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30906/consoleFull) for PR 5637 at commit [`ab38c71`](https://githu

[GitHub] spark pull request: [SPARK-5213] [SQL] Pluggable SQL Parser Suppor...

2015-04-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4015#issuecomment-95786382 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/30

[GitHub] spark pull request: [SPARK-5213] [SQL] Pluggable SQL Parser Suppor...

2015-04-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4015#issuecomment-95786341 [Test build #30897 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/30897/consoleFull) for PR 4015 at commit [`81a731f`](https://gith

[GitHub] spark pull request: [SPARK-7044][SQL] Fix the deadlock in ScriptTr...

2015-04-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/5671#issuecomment-95785614 Thanks. I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-7009] repackaging spark assembly jar wi...

2015-04-23 Thread zhzhan
Github user zhzhan commented on the pull request: https://github.com/apache/spark/pull/5637#issuecomment-95784598 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

  1   2   3   4   5   6   7   >