spark git commit: MAINTENANCE: Automated closing of pull requests.

2015-01-07 Thread pwendell
Repository: spark Updated Branches: refs/heads/master c66a97630 -> c08238570 MAINTENANCE: Automated closing of pull requests. This commit exists to close the following pull requests on Github: Closes #3880 (close requested by 'ash211') Closes #3649 (close requested by 'marmbrus') Closes #3791

spark git commit: [SPARK-5116][MLlib] Add extractor for SparseVector and DenseVector

2015-01-07 Thread meng
Repository: spark Updated Branches: refs/heads/master 2b729d225 -> c66a97630 [SPARK-5116][MLlib] Add extractor for SparseVector and DenseVector Add extractor for SparseVector and DenseVector in MLlib to save some code while performing pattern matching on Vectors. For example, previously we ma

spark git commit: [SPARK-5126][Core] Verify Spark urls before creating Actors so that invalid urls can crash the process.

2015-01-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master d345ebebd -> 2b729d225 [SPARK-5126][Core] Verify Spark urls before creating Actors so that invalid urls can crash the process. Because `actorSelection` will return `deadLetters` for an invalid path, Worker keeps quiet for an invalid mast

svn commit: r1650203 - /spark/site/docs/1.2.0/job-scheduling.html

2015-01-07 Thread andrewor14
Author: andrewor14 Date: Thu Jan 8 02:33:11 2015 New Revision: 1650203 URL: http://svn.apache.org/r1650203 Log: Push dynamic allocation docs Modified: spark/site/docs/1.2.0/job-scheduling.html Modified: spark/site/docs/1.2.0/job-scheduling.html URL: http://svn.apache.org/viewvc/spark/site/

spark git commit: [SPARK-5132][Core]Correct stage Attempt Id key in stageInfofromJson

2015-01-07 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 6d1ca2392 -> 55325afbe [SPARK-5132][Core]Correct stage Attempt Id key in stageInfofromJson SPARK-5132: stageInfoToJson: Stage Attempt Id stageInfoFromJson: Attempt Id Author: hushan[胡珊] Closes #3932 from suyanNone/json-stage and

spark git commit: [SPARK-5132][Core]Correct stage Attempt Id key in stageInfofromJson

2015-01-07 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.2 7a4be0b45 -> 1770c51b2 [SPARK-5132][Core]Correct stage Attempt Id key in stageInfofromJson SPARK-5132: stageInfoToJson: Stage Attempt Id stageInfoFromJson: Attempt Id Author: hushan[胡珊] Closes #3932 from suyanNone/json-stage and

spark git commit: [SPARK-5132][Core]Correct stage Attempt Id key in stageInfofromJson

2015-01-07 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 60e2d9e29 -> d345ebebd [SPARK-5132][Core]Correct stage Attempt Id key in stageInfofromJson SPARK-5132: stageInfoToJson: Stage Attempt Id stageInfoFromJson: Attempt Id Author: hushan[胡珊] Closes #3932 from suyanNone/json-stage and squa

spark git commit: SPARK-5039 [BUILD] Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to "javax.servlet.FilterRegistration's signer information" errors

2015-01-07 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.0 c4fbcaec6 -> b1c1d8612 SPARK-5039 [BUILD] Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to "javax.servlet.FilterRegistration's signer information" errors Add servlet-api excludes from SPARK-1776 to avoid javax.servlet.FilterRegis

spark git commit: [SPARK-5128][MLLib] Add common used log1pExp API in MLUtils

2015-01-07 Thread meng
Repository: spark Updated Branches: refs/heads/master 6e74edeca -> 60e2d9e29 [SPARK-5128][MLLib] Add common used log1pExp API in MLUtils When `x` is positive and large, computing `math.log(1 + math.exp(x))` will lead to arithmetic overflow. This will happen when `x > 709.78` which is not a ve

spark git commit: [SPARK-2458] Make failed application log visible on History Server

2015-01-07 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 8fdd48959 -> 6e74edeca [SPARK-2458] Make failed application log visible on History Server Enabled HistoryServer to show incomplete applications. We can see the log for incomplete applications by clicking the bottom link. Author: Masayoshi

spark git commit: [SPARK-2165][YARN]add support for setting maxAppAttempts in the ApplicationSubmissionContext

2015-01-07 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 5fde66163 -> 8fdd48959 [SPARK-2165][YARN]add support for setting maxAppAttempts in the ApplicationSubmissionContext ...xt https://issues.apache.org/jira/browse/SPARK-2165 I still have 2 questions: * If this config is not set, we should u

spark git commit: [YARN][SPARK-4929] Bug fix: fix the yarn-client code to support HA

2015-01-07 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-1.2 db83acb1f -> 7a4be0b45 [YARN][SPARK-4929] Bug fix: fix the yarn-client code to support HA Nowadays, yarn-client will exit directly when the HA change happens no matter how many times the am should retry. The reason may be that the defa

spark git commit: [YARN][SPARK-4929] Bug fix: fix the yarn-client code to support HA

2015-01-07 Thread tgraves
Repository: spark Updated Branches: refs/heads/master e21acc197 -> 5fde66163 [YARN][SPARK-4929] Bug fix: fix the yarn-client code to support HA Nowadays, yarn-client will exit directly when the HA change happens no matter how many times the am should retry. The reason may be that the default