[GitHub] spark pull request: [SPARK-1773] Update outdated docs for spark-su...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/701#issuecomment-42729688 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14866/ --- If your project

[GitHub] spark pull request: SPARK-1652: Set driver memory correctly in spa...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/730#issuecomment-42763089 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1756: Add missing description to spark-e...

2014-05-11 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/646#discussion_r12507598 --- Diff: conf/spark-env.sh.template --- @@ -38,6 +38,7 @@ # - SPARK_WORKER_INSTANCES, to set the number of worker processes per node # -

[GitHub] spark pull request: SPARK-1652: Set driver memory correctly in spa...

2014-05-11 Thread pwendell
GitHub user pwendell opened a pull request: https://github.com/apache/spark/pull/730 SPARK-1652: Set driver memory correctly in spark-submit. The previous check didn't account for the fact that the default deploy mode is client unless otherwise specified. Also, this sets the

[GitHub] spark pull request: SPARK-1756: Add missing description to spark-e...

2014-05-11 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/646#discussion_r12507600 --- Diff: conf/spark-env.sh.template --- @@ -38,6 +38,7 @@ # - SPARK_WORKER_INSTANCES, to set the number of worker processes per node # -

[GitHub] spark pull request: SPARK-1652: Set driver memory correctly in spa...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/730#issuecomment-42763096 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1652: Set driver memory correctly in spa...

2014-05-11 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/730#issuecomment-42763144 This was reported by @witgo. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1756: Add missing description to spark-e...

2014-05-11 Thread witgo
Github user witgo closed the pull request at: https://github.com/apache/spark/pull/646 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Synthetic GraphX Benchmark

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/720#issuecomment-42756947 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14876/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1759

2014-05-11 Thread pjopensource
GitHub user pjopensource opened a pull request: https://github.com/apache/spark/pull/693 SPARK-1759 You can merge this pull request into a Git repository by running: $ git pull https://github.com/pjopensource/spark branch-0.9 Alternatively you can review and apply these

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/685#issuecomment-42501713 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1157][MLlib] Bug fix: lossHistory shoul...

2014-05-11 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/582#issuecomment-42623759 Thanks, merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1756: Add missing description to spark-e...

2014-05-11 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/646#discussion_r12507619 --- Diff: conf/spark-env.sh.template --- @@ -38,6 +38,7 @@ # - SPARK_WORKER_INSTANCES, to set the number of worker processes per node # -

[GitHub] spark pull request: [SQL] Improve column pruning.

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/729#issuecomment-42763487 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SQL] Improve column pruning.

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/729#issuecomment-42763488 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14883/ --- If your project

[GitHub] spark pull request: remove outdated runtime Information scala home

2014-05-11 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/728#issuecomment-42763506 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1686: keep schedule() calling in the mai...

2014-05-11 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/639#discussion_r12490657 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/MasterMessages.scala --- @@ -39,4 +39,6 @@ private[master] object MasterMessages { case

[GitHub] spark pull request: remove outdated runtime Information scala home

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/728#issuecomment-42763556 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1652: Set driver memory correctly in spa...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/730#issuecomment-42763555 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14884/ --- If your project

[GitHub] spark pull request: remove outdated runtime Information scala home

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/728#issuecomment-42763553 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-11 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/685#discussion_r12503350 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/NumericParser.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-11 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/685#discussion_r12502576 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/NumericParser.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-1652: Set driver memory correctly in spa...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/730#issuecomment-42763554 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [RFC] SPARK-1772 Stop catching Throwable, let ...

2014-05-11 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/715#issuecomment-42763346 /cc @scrapcodes who worked on the IndestructableActorSystem --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: SPARK-1795 - Add recursive directory file sear...

2014-05-11 Thread patrickotoole
Github user patrickotoole commented on a diff in the pull request: https://github.com/apache/spark/pull/537#discussion_r12507593 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala --- @@ -327,18 +327,18 @@ class StreamingContext private[streaming]

[GitHub] spark pull request: SPARK-1756: Add missing description to spark-e...

2014-05-11 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/646#issuecomment-42763279 A better solution [PR 730](https://github.com/apache/spark/pull/730) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: remove outdated runtime Information scala home

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/728#issuecomment-42764076 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14885/ --- If your project

[GitHub] spark pull request: remove outdated runtime Information scala home

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/728#issuecomment-42764075 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [WIP]SPARK-1706: Allow multiple executors per ...

2014-05-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12507640 --- Diff: core/src/main/scala/org/apache/spark/deploy/ApplicationDescription.scala --- @@ -28,6 +28,7 @@ private[spark] class ApplicationDescription(

[GitHub] spark pull request: SPARK-1791 - SVM implementation does not use t...

2014-05-11 Thread ajtulloch
GitHub user ajtulloch opened a pull request: https://github.com/apache/spark/pull/725 SPARK-1791 - SVM implementation does not use threshold parameter Summary: https://issues.apache.org/jira/browse/SPARK-1791 Simple fix, and backward compatible, since - anyone

[GitHub] spark pull request: [SPARK-1774] Respect SparkSubmit --jars on YAR...

2014-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/710 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Enabled incremental build that comes with sbt ...

2014-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/525 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SQL] Upgrade parquet library.

2014-05-11 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/684#issuecomment-42750659 Thanks for taking a look michael - I merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-1773] Update outdated docs for spark-su...

2014-05-11 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/701#discussion_r12505284 --- Diff: docs/spark-standalone.md --- @@ -150,20 +162,30 @@ You can also pass an option `--cores numCores` to control the number of cores Spark

[GitHub] spark pull request: The org.datanucleus:* should not be packaged i...

2014-05-11 Thread witgo
GitHub user witgo opened a pull request: https://github.com/apache/spark/pull/688 The org.datanucleus:* should not be packaged into spark-assembly-*.jar You can merge this pull request into a Git repository by running: $ git pull https://github.com/witgo/spark SPARK-1644

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42427401 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [WIP] Simplify the build with sbt 0.13.2 featu...

2014-05-11 Thread markhamstra
Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/706#issuecomment-42697568 https://issues.apache.org/jira/browse/SPARK-1776 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: L-BFGS Documentation

2014-05-11 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/702#discussion_r12460491 --- Diff: docs/mllib-optimization.md --- @@ -163,3 +177,100 @@ each iteration, to compute the gradient direction. Available algorithms for gradient

[GitHub] spark pull request: [Docs] Update YARN and standalone docs

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/701#issuecomment-42713025 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1789. Multiple versions of Netty depende...

2014-05-11 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/723#discussion_r12507895 --- Diff: core/src/test/scala/org/apache/spark/LocalSparkContext.scala --- @@ -17,8 +17,7 @@ package org.apache.spark -import

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-11 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/685#discussion_r12502581 --- Diff: python/pyspark/mllib/linalg.py --- @@ -234,6 +233,45 @@ def dense(elements): return array(elements, dtype=float64) +

[GitHub] spark pull request: [RFC] SPARK-1772 Stop catching Throwable, let ...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/715#issuecomment-42716337 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14854/ --- If your project

[GitHub] spark pull request: SPARK-1565, update examples to be used with sp...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/552#issuecomment-42520748 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1789. Multiple versions of Netty depende...

2014-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/723 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Fixed streaming examples docs to use run-examp...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/722#issuecomment-42738393 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Synthetic GraphX Benchmark

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/720#issuecomment-42756921 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1565 (Addendum): Replace `run-example` w...

2014-05-11 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/704#discussion_r12462266 --- Diff: bin/run-example --- @@ -49,46 +31,31 @@ fi if [[ -z $SPARK_EXAMPLES_JAR ]]; then echo Failed to find Spark examples assembly in

[GitHub] spark pull request: [SPARK-1688] Propagate PySpark worker stderr t...

2014-05-11 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/603#discussion_r12388303 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonWorkerFactory.scala --- @@ -208,6 +170,19 @@ private[spark] class

[GitHub] spark pull request: Include the sbin/spark-config.sh in spark-exec...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/651#issuecomment-42608067 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/636#issuecomment-42504239 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1668: Add implicit preference as an opti...

2014-05-11 Thread techaddict
Github user techaddict commented on a diff in the pull request: https://github.com/apache/spark/pull/597#discussion_r12389144 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/MovieLensALS.scala --- @@ -121,11 +157,14 @@ object MovieLensALS { }

[GitHub] spark pull request: Typo fix: fetchting - fetching

2014-05-11 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/680#issuecomment-42485074 Thanks. Merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [WIP] Simplify the build with sbt 0.13.2 featu...

2014-05-11 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/706#discussion_r12508408 --- Diff: project/SparkBuild.scala --- @@ -297,7 +273,7 @@ object SparkBuild extends Build { val chillVersion = 0.3.6 val

[GitHub] spark pull request: [WIP] Simplify the build with sbt 0.13.2 featu...

2014-05-11 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/706#issuecomment-42768086 This is what Patrick was trying to say https://issues.apache.org/jira/browse/SPARK-1776. So while we have this on our mind, even if we merge this patch it has to

[GitHub] spark pull request: [WIP]SPARK-1706: Allow multiple executors per ...

2014-05-11 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12508764 --- Diff: core/src/main/scala/org/apache/spark/deploy/ApplicationDescription.scala --- @@ -28,6 +28,7 @@ private[spark] class ApplicationDescription(

[GitHub] spark pull request: [SPARK-1690] Tolerating empty elements when sa...

2014-05-11 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/644#issuecomment-42752706 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1688] Propagate PySpark worker stderr t...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/603#issuecomment-42469138 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14780/ --- If your project

[GitHub] spark pull request: [SQL] Fix Performance Issue in data type casti...

2014-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/679 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1749] Job cancellation when SchedulerBa...

2014-05-11 Thread markhamstra
Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/686#issuecomment-42494200 @CodingCat @kayousterhout @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: SPARK-1668: Add implicit preference as an opti...

2014-05-11 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/597#discussion_r12407485 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/MovieLensALS.scala --- @@ -121,11 +157,23 @@ object MovieLensALS { } /**

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42489547 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Docs] Update YARN docs

2014-05-11 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/701#discussion_r12456854 --- Diff: docs/running-on-yarn.md --- @@ -68,11 +69,12 @@ In yarn-cluster mode, the driver runs on a different machine than the client, so $

[GitHub] spark pull request: Bug fix of sparse vector conversion

2014-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/661 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1631] Correctly set the Yarn app name w...

2014-05-11 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/539#issuecomment-42512812 I dug through the code a bunch. For those following this PR, here's a quick summary. Looks like the way we set Spark app name on YARN is actually quite convoluted

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/497#issuecomment-42483855 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1749] Job cancellation when SchedulerBa...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/686#issuecomment-42494319 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14790/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1565 (Addendum): Replace `run-example` w...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/704#issuecomment-42633729 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1588 Re-add support for SPARK_YARN_USER_...

2014-05-11 Thread mridulm
Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/514#issuecomment-42525085 Closing this assuming it has been resolved through other PR's. Please let me know in case this is not the case. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: Include the sbin/spark-config.sh in spark-exec...

2014-05-11 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/651#discussion_r12450552 --- Diff: sbin/spark-executor --- @@ -19,5 +19,10 @@ FWDIR=$(cd `dirname $0`/..; pwd) +sbin=`dirname $0` +sbin=`cd $sbin; pwd` +

[GitHub] spark pull request: [Spark-1461] Deferred Expression Evaluation (s...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/446#issuecomment-42718954 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-1779] add warning when memoryFraction i...

2014-05-11 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/714#issuecomment-42770141 Hi @pwendell, thanks. I didn't notice validateSettings in SparkConf and it's good to validate this in it. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-1470] Spark logger moving to use scala-...

2014-05-11 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/332#issuecomment-42771828 @pwendell @marmbrus @rxin typesafehub/scala-logging#4 has been solved by typesafehub/scala-logging#15 The PR should be able to merge into master master --- If

[GitHub] spark pull request: [WIP]SPARK-1706: Allow multiple executors per ...

2014-05-11 Thread CodingCat
Github user CodingCat closed the pull request at: https://github.com/apache/spark/pull/636 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [WIP]SPARK-1706: Allow multiple executors per ...

2014-05-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12509207 --- Diff: core/src/main/scala/org/apache/spark/deploy/ApplicationDescription.scala --- @@ -28,6 +28,7 @@ private[spark] class ApplicationDescription(

[GitHub] spark pull request: SPARK-1798. Tests should clean up temp files

2014-05-11 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/732 SPARK-1798. Tests should clean up temp files Three issues related to temp files that tests generate – these should be touched up for hygiene but are not urgent. Modules have a

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/731#issuecomment-42772900 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Synthetic GraphX Benchmark

2014-05-11 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/720#discussion_r12502303 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/lib/SynthBenchmark.scala --- @@ -0,0 +1,136 @@ +package org.apache.spark.graphx.lib +

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/731#issuecomment-42773948 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/731#issuecomment-42773949 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14886/ --- If your project

[GitHub] spark pull request: SPARK-1798. Tests should clean up temp files

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/732#issuecomment-42773573 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/731#issuecomment-42772897 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP] Simplify the build with sbt 0.13.2 featu...

2014-05-11 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/706#discussion_r12509377 --- Diff: project/SparkBuild.scala --- @@ -297,7 +273,7 @@ object SparkBuild extends Build { val chillVersion = 0.3.6 val

[GitHub] spark pull request: L-BFGS Documentation

2014-05-11 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/702#discussion_r12460376 --- Diff: docs/mllib-optimization.md --- @@ -163,3 +177,100 @@ each iteration, to compute the gradient direction. Available algorithms for gradient

[GitHub] spark pull request: [WIP] Simplify the build with sbt 0.13.2 featu...

2014-05-11 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/706#discussion_r12489193 --- Diff: project/SparkBuild.scala --- @@ -16,17 +16,18 @@ */ import sbt._ -import sbt.Classpaths.publishTask -import sbt.Keys._

[GitHub] spark pull request: SPARK-1556. jets3t dep doesn't update properly...

2014-05-11 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/629#issuecomment-42673811 Although there's now a 'fix' in, it is only going to do automatically what you are doing by hand. My hunch is that perhaps the script, or env variable, already contains

[GitHub] spark pull request: Update RoutingTable.scala

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/647#issuecomment-42465768 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1755] Respect SparkSubmit --name on YAR...

2014-05-11 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/699#issuecomment-42630934 I've merged this thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: L-BFGS Documentation

2014-05-11 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/702#discussion_r12460451 --- Diff: docs/mllib-optimization.md --- @@ -163,3 +177,100 @@ each iteration, to compute the gradient direction. Available algorithms for gradient

[GitHub] spark pull request: Unify GraphImpl RDDs + other graph load optimi...

2014-05-11 Thread ankurdave
Github user ankurdave commented on a diff in the pull request: https://github.com/apache/spark/pull/497#discussion_r12456034 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/impl/ReplicatedVertexView.scala --- @@ -21,192 +21,102 @@ import scala.reflect.{classTag, ClassTag}

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42423123 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1556. jets3t dep doesn't update properly...

2014-05-11 Thread darose
Github user darose commented on the pull request: https://github.com/apache/spark/pull/629#issuecomment-42635850 I tried downloading the latest from the master branch of both spark and shark, and built and ran them (in the hopes of getting past that class incompatible issue) but no

[GitHub] spark pull request: Use numpy directly for matrix multiply.

2014-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/687 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1774] Respect SparkSubmit --jars on YAR...

2014-05-11 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/710#issuecomment-42634045 We may not always want to automatically add the jar to `spark.jar`. I will spend some time looking into cases in which we want to skip this (which likely involves

[GitHub] spark pull request: [Docs] Update YARN and standalone docs

2014-05-11 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/701#issuecomment-42715097 thanks for the update, the changes look good to me. I did notice one other thing in the yarn docs and that is that we don't say what parameters spark-shell

[GitHub] spark pull request: SPARK-1798. Tests should clean up temp files

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/732#issuecomment-42773567 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1798. Tests should clean up temp files

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/732#issuecomment-42774629 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1798. Tests should clean up temp files

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/732#issuecomment-42774630 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14887/ --- If your project

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/731#issuecomment-42774784 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Add init script to the debian packaging

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/733#issuecomment-42775785 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-11 Thread CodingCat
GitHub user CodingCat opened a pull request: https://github.com/apache/spark/pull/731 SPARK-1706: Allow multiple executors per worker in Standalone mode resubmit of SPARK-1706 for a totally different algorithm You can merge this pull request into a Git repository by running: $

  1   2   3   >