[GitHub] spark pull request: [SPARK-8598] [MLlib] Implementation of 1-sampl...

2015-07-01 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/6994#issuecomment-117808024 @josepablocam In the PR description, please also include a summary of this PR because it becomes part of the commit message. --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread dragos
Github user dragos commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33718904 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala --- @@ -124,10 +124,16 @@ private[spark] class DiskBlockManager(blockManager:

[GitHub] spark pull request: [SPARK-8378][Streaming]Add the Python API for ...

2015-07-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6830 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-3071] Increase default driver memory

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7132#issuecomment-117797061 [Test build #36282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36282/console) for PR 7132 at commit

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-07-01 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/7099#discussion_r33713764 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/evaluation/RegressionMetrics.scala --- @@ -31,7 +31,8 @@ import org.apache.spark.sql.DataFrame

[GitHub] spark pull request: [SPARK-4485][SQL] (1) Add broadcast hash outer...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7162#issuecomment-117799843 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33715021 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1241,8 +1253,37 @@ private[spark] class BlockManager(

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7099#issuecomment-117800789 [Test build #36295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36295/consoleFull) for PR 7099 at commit

[GitHub] spark pull request: [WIP][SPARK-8313] R Spark packages support

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-117800747 [Test build #36294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36294/consoleFull) for PR 7139 at commit

[GitHub] spark pull request: [SPARK-7820][Build] Fix Java8-tests suite comp...

2015-07-01 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7120#issuecomment-117801763 LGTM, so I'm going to merge this into master and branch-1.4. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-5562][MLlib] LDA should handle empty do...

2015-07-01 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/7064#discussion_r33716204 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala --- @@ -119,6 +120,14 @@ final class EMLDAOptimizer extends

[GitHub] spark pull request: [SPARK-3444] [core] Restore INFO level after l...

2015-07-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7140 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-746][CORE][WIP] Added Avro Serializatio...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-117805703 [Test build #36298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36298/consoleFull) for PR 7004 at commit

[GitHub] spark pull request: [SPARK-8660][ML] Convert JavaDoc style comment...

2015-07-01 Thread Rosstin
Github user Rosstin commented on a diff in the pull request: https://github.com/apache/spark/pull/7096#discussion_r33719147 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/LogisticRegressionSuite.scala --- @@ -211,22 +211,22 @@ class LogisticRegressionSuite

[GitHub] spark pull request: [SPARK-5016][MLLib] Distribute GMM mixture com...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7166#issuecomment-117817655 [Test build #36301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36301/consoleFull) for PR 7166 at commit

[GitHub] spark pull request: [SPARK-5016][MLLib] Distribute GMM mixture com...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7166#issuecomment-117817442 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-07-01 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/7099#discussion_r33712588 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -193,11 +199,36 @@ class LinearRegression(override val uid:

[GitHub] spark pull request: [SPARK-8598] [MLlib] Implementation of 1-sampl...

2015-07-01 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/6994#discussion_r33713902 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/stat/Statistics.scala --- @@ -158,4 +158,25 @@ object Statistics { def chiSqTest(data:

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7099#issuecomment-117799304 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7099#issuecomment-117799319 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33714143 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1223,6 +1232,9 @@ private[spark] class BlockManager( }

[GitHub] spark pull request: [SPARK-4072][Core]Display Streaming blocks in ...

2015-07-01 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/6672#issuecomment-117799361 @JoshRosen Any more thoughts on this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8660][ML] Convert JavaDoc style comment...

2015-07-01 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7096#discussion_r33714571 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/LogisticRegressionSuite.scala --- @@ -211,22 +211,22 @@ class LogisticRegressionSuite

[GitHub] spark pull request: [SPARK-8660][ML] Convert JavaDoc style comment...

2015-07-01 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7096#discussion_r33714575 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/LogisticRegressionSuite.scala --- @@ -211,22 +211,22 @@ class LogisticRegressionSuite

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33714625 --- Diff: network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleClient.java --- @@ -138,6 +139,26 @@ public void

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7099#issuecomment-117800161 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread dragos
Github user dragos commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33719412 --- Diff: network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleClient.java --- @@ -138,6 +139,26 @@ public void

[GitHub] spark pull request: [SPARK-5016] Distribute GMM mixture components...

2015-07-01 Thread feynmanliang
GitHub user feynmanliang opened a pull request: https://github.com/apache/spark/pull/7166 [SPARK-5016] Distribute GMM mixture components to executors Distribute expensive portions of computation for Gaussian mixture components (in particular, pre-computation of

[GitHub] spark pull request: [SPARK-8647][MLlib] Potential issue with const...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7146#issuecomment-117798423 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-07-01 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/7099#issuecomment-117798935 It wasn't clear to me how to use DFs in the result classes I was creating since they didn't have access to the model parameters (featuresCol, predictionCol, etc).

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33714016 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -111,12 +113,19 @@ private[spark] class BlockManager( //

[GitHub] spark pull request: [ML][Minor] update transformSchema methods of ...

2015-07-01 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/6433#issuecomment-117799019 @RoyGao Could you please create a JIRA and add it to this PR's title? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33714710 --- Diff: core/src/test/scala/org/apache/spark/scheduler/mesos/CoarseMesosSchedulerBackendSuite.scala --- @@ -0,0 +1,187 @@ +/* + * Licensed to

[GitHub] spark pull request: [WIP][SPARK-8313] R Spark packages support

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-117800154 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP][SPARK-8313] R Spark packages support

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-117800176 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7099#issuecomment-117800175 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33714772 --- Diff: core/src/test/scala/org/apache/spark/scheduler/mesos/CoarseMesosSchedulerBackendSuite.scala --- @@ -0,0 +1,187 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-746][CORE][WIP] Added Avro Serializatio...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-117805393 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-746][CORE][WIP] Added Avro Serializatio...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-117805408 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-746][CORE][WIP] Added Avro Serializatio...

2015-07-01 Thread JDrit
Github user JDrit commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r33716906 --- Diff: core/pom.xml --- @@ -398,6 +398,40 @@ artifactIdpy4j/artifactId version0.8.2.1/version /dependency +dependency

[GitHub] spark pull request: [SPARK-8598] [MLlib] Implementation of 1-sampl...

2015-07-01 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/6994#discussion_r33717906 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/stat/test/KSTest.scala --- @@ -0,0 +1,191 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-8538][SPARK-8539][ML] Linear Regression...

2015-07-01 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/7099#issuecomment-117813319 It wasn't clear to me how to use DFs in the result classes I was creating since they didn't have access to the model parameters (featuresCol, predictionCol, etc). I

[GitHub] spark pull request: [SPARK-8479] [MLlib] Add numNonzeros and numAc...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6904#issuecomment-117815373 [Test build #36288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36288/console) for PR 6904 at commit

[GitHub] spark pull request: [SPARK-8766] support non-ascii character in co...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7165#issuecomment-117816111 [Test build #36299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36299/consoleFull) for PR 7165 at commit

[GitHub] spark pull request: [SPARK-8660] [MLLib] removed symbols from co...

2015-07-01 Thread Rosstin
GitHub user Rosstin opened a pull request: https://github.com/apache/spark/pull/7167 [SPARK-8660] [MLLib] removed symbols from comments in LogisticRegressionSuite.scala for ease of copypaste '' symbols removed from comments in LogisticRegressionSuite.scala, for ease of copypaste

[GitHub] spark pull request: [Spark-8703] [ML] Add CountVectorizer as a ml ...

2015-07-01 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/7084#discussion_r33722239 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/CountVectorizer.scala --- @@ -0,0 +1,73 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-8660] [MLLib] removed symbols from co...

2015-07-01 Thread Rosstin
Github user Rosstin commented on the pull request: https://github.com/apache/spark/pull/7167#issuecomment-117820353 @mengxr Would it be desirable to un-multiline the LOC in the file's comments? Or should these remain multiline to follow style? (What I mean is, the lines are long

[GitHub] spark pull request: [SPARK-8425][Core][WIP] Add blacklist mechanis...

2015-07-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6870#discussion_r33723836 --- Diff: core/src/test/scala/org/apache/spark/scheduler/ExecutorBlacklistTrackerSuite.scala --- @@ -0,0 +1,158 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-07-01 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-117826371 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8660] [MLLib] removed symbols from co...

2015-07-01 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/7167#issuecomment-117826411 For copypasteing in Scala mode :paste mode makes the multi-line copy/past work well (although requires remembering that + ctrl-d) --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-7977] [Build] Disallowing println

2015-07-01 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7093#discussion_r33725936 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala --- @@ -253,7 +253,9 @@ class PairUDF extends GenericUDF { )

[GitHub] spark pull request: [SPARK-7977] [Build] Disallowing println

2015-07-01 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7093#discussion_r33725957 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/InsertIntoHiveTableSuite.scala --- @@ -87,7 +87,9 @@ class InsertIntoHiveTableSuite extends

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5423#issuecomment-117828706 [Test build #36303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36303/consoleFull) for PR 5423 at commit

[GitHub] spark pull request: [SPARK-7977] [Build] Disallowing println

2015-07-01 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7093#discussion_r33726438 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -684,7 +684,9 @@ class UtilsSuite extends SparkFunSuite with ResetSystemProperties

[GitHub] spark pull request: [SPARK-5095][MESOS] Support capping cores and ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/4027#issuecomment-117832235 @tnachen can you address the comments to simplify this patch using `spark.executor.cores` instead? As discussed above this is an optional setting and reuses the same

[GitHub] spark pull request: [SPARK-8450] [SQL] [PYSARK] cleanup type conve...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7131#issuecomment-117832863 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5095][MESOS] Support capping cores and ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4027#discussion_r33728044 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -109,6 +123,13 @@ private[spark] class

[GitHub] spark pull request: [SPARK-8450] [SQL] [PYSARK] cleanup type conve...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7131#issuecomment-117832900 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8450] [SQL] [PYSARK] cleanup type conve...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7131#issuecomment-117835854 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8450] [SQL] [PYSARK] cleanup type conve...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7131#issuecomment-117835834 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8766] support non-ascii character in co...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7165#issuecomment-117837584 [Test build #36306 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36306/console) for PR 7165 at commit

[GitHub] spark pull request: [SPARK-8425][Core][WIP] Add blacklist mechanis...

2015-07-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6870#discussion_r33729664 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ExecutorBlacklistTracker.scala --- @@ -0,0 +1,175 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-8660] [MLLib] removed symbols from co...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7167#issuecomment-117820196 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8746][SQL] update download link for Hiv...

2015-07-01 Thread ckadner
Github user ckadner commented on the pull request: https://github.com/apache/spark/pull/7144#issuecomment-117820180 @JoshRosen -- Hi Josh, thanks for kicking of the tests. Can you help me make sense of the test results? I only changed a markdown file, no test cases should be

[GitHub] spark pull request: [SPARK-8695] [core] [WIP] TreeAggregation shou...

2015-07-01 Thread piganesh
GitHub user piganesh opened a pull request: https://github.com/apache/spark/pull/7168 [SPARK-8695] [core] [WIP] TreeAggregation shouldn't be triggered for … …5 partitions You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-117823839 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-117823675 **[Test build #36289 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36289/console)** for PR 6648 at commit

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-117827909 [Test build #36302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36302/consoleFull) for PR 6648 at commit

[GitHub] spark pull request: [SPARK-1564] [Docs] Added Javascript to Javado...

2015-07-01 Thread deroneriksson
GitHub user deroneriksson opened a pull request: https://github.com/apache/spark/pull/7169 [SPARK-1564] [Docs] Added Javascript to Javadocs to create badges for tags like :: Experimental :: Modified copy_api_dirs.rb and created api-javadocs.js and api-javadocs.css files in order

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33726149 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala --- @@ -124,10 +124,16 @@ private[spark] class

[GitHub] spark pull request: [SPARK-7977] [Build] Disallowing println

2015-07-01 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/7093#issuecomment-117829855 Heroic effort here. It certainly is big but is fixing up a lot of little issues of this form. I flagged a few more questions about it but it is looking pretty good.

[GitHub] spark pull request: [SPARK-1564] [Docs] Added Javascript to Javado...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7169#issuecomment-117831150 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1564] [Docs] Added Javascript to Javado...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7169#issuecomment-117831126 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP][SPARK-8313] R Spark packages support

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-117832007 [Test build #36294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36294/console) for PR 7139 at commit

[GitHub] spark pull request: [WIP][SPARK-8313] R Spark packages support

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-117832118 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6910] [WiP] Reduce number of operations...

2015-07-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7049#discussion_r33727646 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -379,31 +379,25 @@ abstract class HadoopFsRelation

[GitHub] spark pull request: [SPARK-8450] [SQL] [PYSARK] cleanup type conve...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7131#issuecomment-117833346 [Test build #36305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36305/consoleFull) for PR 7131 at commit

[GitHub] spark pull request: [SPARK-8766] support non-ascii character in co...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7165#issuecomment-117834553 [Test build #36306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36306/consoleFull) for PR 7165 at commit

[GitHub] spark pull request: [SPARK-8425][Core][WIP] Add blacklist mechanis...

2015-07-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6870#discussion_r33729199 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ExecutorBlacklistTracker.scala --- @@ -0,0 +1,175 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [WIP][SPARK-8313] R Spark packages support

2015-07-01 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-117835313 @JoshRosen @shaneknapp -- So in this case the SparkR unit tests failed but the AmpLabJenkins message says Test Passed ? Do you know what could cause this ? --- If

[GitHub] spark pull request: [SPARK-8660] [MLLib] removed symbols from co...

2015-07-01 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/7167#issuecomment-117837038 Let's keep the line width within 100. As @holdenk mentioned, we can copy paste a paragraph of code to Scala and ipython easily. I also tried RStudio, which takes

[GitHub] spark pull request: [SPARK-8450] [SQL] [PYSARK] cleanup type conve...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7131#issuecomment-117836993 [Test build #36307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36307/consoleFull) for PR 7131 at commit

[GitHub] spark pull request: [SPARK-3071] Increase default driver memory

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7132#issuecomment-117818124 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-3071] Increase default driver memory

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7132#issuecomment-117818081 [Test build #36291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36291/console) for PR 7132 at commit

[GitHub] spark pull request: [SPARK-7977] [Build] Disallowing println

2015-07-01 Thread jonalter
Github user jonalter commented on the pull request: https://github.com/apache/spark/pull/7093#issuecomment-117820014 @srowen - I have addressed the point you made regarding using log rather than println in some cases. Please let me know what you think. Thank you. --- If your project

[GitHub] spark pull request: [SPARK-8746][SQL] update download link for Hiv...

2015-07-01 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7144#issuecomment-117821666 This is a rare build flakiness issue that we haven't diagnosed. I kicked off tests just to test out a pull request builder script change. This change looks fine to

[GitHub] spark pull request: [SPARK-8695] [core] [WIP] TreeAggregation shou...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7168#issuecomment-117823182 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [WIP][SPARK-8313] R Spark packages support

2015-07-01 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-117825520 @brkyvz Thanks for sending out this PR. Its looking good. I had a couple of high level points 1. It might be good to point out in some of the error messages how the

[GitHub] spark pull request: [SPARK-5016][MLLib] Distribute GMM mixture com...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7166#issuecomment-117825624 [Test build #36301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36301/console) for PR 7166 at commit

[GitHub] spark pull request: [SPARK-7977] [Build] Disallowing println

2015-07-01 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/7093#discussion_r33726211 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/util/NumericParserSuite.scala --- @@ -33,7 +33,9 @@ class NumericParserSuite extends SparkFunSuite {

[GitHub] spark pull request: SPARK-1537 [WiP] Application Timeline Server i...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5423#issuecomment-117828238 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5095][MESOS] Support capping cores and ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4027#discussion_r33728151 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -211,35 +226,43 @@ private[spark] class

[GitHub] spark pull request: [SPARK-8766] support non-ascii character in co...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7165#issuecomment-117833781 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1564] [Docs] Added Javascript to Javado...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7169#issuecomment-117833756 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8425][Core][WIP] Add blacklist mechanis...

2015-07-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6870#discussion_r33728907 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ExecutorBlacklistTracker.scala --- @@ -0,0 +1,175 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-8425][Core][WIP] Add blacklist mechanis...

2015-07-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6870#discussion_r33729777 --- Diff: core/src/test/scala/org/apache/spark/scheduler/ExecutorBlacklistTrackerSuite.scala --- @@ -0,0 +1,158 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-8766] support non-ascii character in co...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7165#issuecomment-117837626 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8766] support non-ascii character in co...

2015-07-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7165#issuecomment-117818193 [Test build #36299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36299/console) for PR 7165 at commit

[GitHub] spark pull request: [SPARK-8766] support non-ascii character in co...

2015-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7165#issuecomment-117818218 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6287][MESOS] Add dynamic allocation to ...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/4984#discussion_r33723361 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala --- @@ -124,10 +124,16 @@ private[spark] class

<    1   2   3   4   5   6   7   8   9   10   >