spark git commit: [SPARK-5122] Remove Shark from spark-ec2

2015-01-08 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 48cecf673 - 167a5ab0b [SPARK-5122] Remove Shark from spark-ec2 I moved the Spark-Shark version map [to the wiki](https://cwiki.apache.org/confluence/display/SPARK/Spark-Shark+version+mapping). This PR has a [matching PR in

spark git commit: [SPARK-4048] Enhance and extend hadoop-provided profile.

2015-01-08 Thread pwendell
Repository: spark Updated Branches: refs/heads/master c9c8b219a - 48cecf673 [SPARK-4048] Enhance and extend hadoop-provided profile. This change does a few things to make the hadoop-provided profile more useful: - Create new profiles for other libraries / services that might be provided by

svn commit: r1650452 - in /spark: downloads.md site/downloads.html

2015-01-08 Thread pwendell
Author: pwendell Date: Fri Jan 9 07:12:13 2015 New Revision: 1650452 URL: http://svn.apache.org/r1650452 Log: Adding download text relating to Scala 2.11 Modified: spark/downloads.md spark/site/downloads.html Modified: spark/downloads.md URL:

spark git commit: [SPARK-4973][CORE] Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled

2015-01-08 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.2 755f9cc40 - 71471bd79 [SPARK-4973][CORE] Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled When we enables external shuffle service, local directories in the

spark git commit: [SPARK-4973][CORE] Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled

2015-01-08 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 72df5a301 - a00af6bec [SPARK-4973][CORE] Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled When we enables external shuffle service, local directories in the

spark git commit: [SPARK-4891][PySpark][MLlib] Add gamma/log normal/exp dist sampling to P...

2015-01-08 Thread meng
Repository: spark Updated Branches: refs/heads/master a00af6bec - c9c8b219a [SPARK-4891][PySpark][MLlib] Add gamma/log normal/exp dist sampling to P... ...ySpark MLlib This is a follow up to PR3680 https://github.com/apache/spark/pull/3680 . Author: RJ Nowling rnowl...@gmail.com Closes

[2/2] spark git commit: SPARK-5087. [YARN] Merge yarn.Client and yarn.ClientBase

2015-01-08 Thread andrewor14
SPARK-5087. [YARN] Merge yarn.Client and yarn.ClientBase Author: Sandy Ryza sa...@cloudera.com Closes #3896 from sryza/sandy-spark-5087 and squashes the following commits: 65611d0 [Sandy Ryza] Review feedback 3294176 [Sandy Ryza] SPARK-5087. [YARN] Merge yarn.Client and yarn.ClientBase

spark git commit: [SPARK-4917] Add a function to convert into a graph with canonical edges in GraphOps

2015-01-08 Thread ankurdave
Repository: spark Updated Branches: refs/heads/master 8d45834de - f825e193f [SPARK-4917] Add a function to convert into a graph with canonical edges in GraphOps Convert bi-directional edges into uni-directional ones instead of 'canonicalOrientation' in GraphLoader.edgeListFile. This

spark git commit: [SPARK-4989][CORE] avoid wrong eventlog conf cause cluster down in standalone mode

2015-01-08 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master f825e193f - 06dc4b520 [SPARK-4989][CORE] avoid wrong eventlog conf cause cluster down in standalone mode when enabling eventlog in standalone mode, if give the wrong configuration, the standalone cluster will down (cause master restart,

spark git commit: [Minor] Fix the value represented by spark.executor.id for consistency.

2015-01-08 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 06dc4b520 - 0a597276d [Minor] Fix the value represented by spark.executor.id for consistency. The property `spark.executor.id` can represent both `driver` and `driver` for one driver. It's inconsistent. This issue is minor so I didn't

spark git commit: [SPARK-5130][Deploy]Take yarn-cluster as cluster mode in spark-submit

2015-01-08 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 0a597276d - 0760787da [SPARK-5130][Deploy]Take yarn-cluster as cluster mode in spark-submit https://issues.apache.org/jira/browse/SPARK-5130 Author: WangTaoTheTonic barneystin...@aliyun.com Closes #3929 from WangTaoTheTonic/SPARK-5130

spark git commit: [SPARK-5130][Deploy]Take yarn-cluster as cluster mode in spark-submit

2015-01-08 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.2 1770c51b2 - 755f9cc40 [SPARK-5130][Deploy]Take yarn-cluster as cluster mode in spark-submit https://issues.apache.org/jira/browse/SPARK-5130 Author: WangTaoTheTonic barneystin...@aliyun.com Closes #3929 from

spark git commit: Document that groupByKey will OOM for large keys

2015-01-08 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 0760787da - 538f22162 Document that groupByKey will OOM for large keys This pull request is my own work and I license it under Spark's open-source license. This contribution is an improvement to the documentation. I documented that the