Git Push Summary

2014-05-26 Thread tdas
Repository: spark Updated Tags: refs/tags/v1.0.0-rc11 [deleted] 522777f7e

git commit: [maven-release-plugin] prepare release v1.0.0-rc11

2014-05-26 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 caed16e4c - c69d97cdb [maven-release-plugin] prepare release v1.0.0-rc11 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c69d97cd Tree:

git commit: [maven-release-plugin] prepare release v1.0.0-rc11

2014-05-25 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 7273bfc03 - 2f1dc868e [maven-release-plugin] prepare release v1.0.0-rc11 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2f1dc868 Tree:

Git Push Summary

2014-05-25 Thread tdas
Repository: spark Updated Tags: refs/tags/v1.0.0-rc11 [created] 522777f7e

git commit: SPARK-1911: Emphasize that Spark jars should be built with Java 6.

2014-05-24 Thread tdas
Repository: spark Updated Branches: refs/heads/master 5081a0a9d - 75a032777 SPARK-1911: Emphasize that Spark jars should be built with Java 6. This commit requires the user to manually say yes when buiding Spark without Java 6. The prompt can be bypassed with a flag (e.g. if the user is

git commit: Updated CHANGES.txt

2014-05-24 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 217bd5627 - 840609272 Updated CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/84060927 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/84060927

git commit: [SPARK-1870] Make spark-submit --jars work in yarn-cluster mode.

2014-05-22 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 75af8bd33 - 79cd26c52 [SPARK-1870] Make spark-submit --jars work in yarn-cluster mode. Sent secondary jars to distributed cache of all containers and add the cached jars to classpath before executors start. Tested on a YARN cluster

git commit: [SPARK-1897] Respect spark.jars (and --jars) in spark-shell

2014-05-22 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 a56621622 - 23cc40e39 [SPARK-1897] Respect spark.jars (and --jars) in spark-shell Spark shell currently overwrites `spark.jars` with `ADD_JARS`. In all modes except yarn-cluster, this means the `--jar` flag passed to `bin/spark-shell`

git commit: [SPARK-1896] Respect spark.master (and --master) before MASTER in spark-shell

2014-05-22 Thread tdas
Repository: spark Updated Branches: refs/heads/master 8edbee7d1 - cce77457e [SPARK-1896] Respect spark.master (and --master) before MASTER in spark-shell The hierarchy for configuring the Spark master in the shell is as follows: ``` MASTER --master spark.master (spark-defaults.conf) ```

git commit: Updated scripts for auditing releases

2014-05-22 Thread tdas
projects for testing functionality of `spark-sql` and `spark-hive` - Fixed issues in existing tests that might have come up because of changes in Spark 1.0 Author: Tathagata Das tathagata.das1...@gmail.com Closes #844 from tdas/update-dev-scripts and squashes the following commits: 25090ba [Tathagata

git commit: Updated scripts for auditing releases

2014-05-22 Thread tdas
projects for testing functionality of `spark-sql` and `spark-hive` - Fixed issues in existing tests that might have come up because of changes in Spark 1.0 Author: Tathagata Das tathagata.das1...@gmail.com Closes #844 from tdas/update-dev-scripts and squashes the following commits: 25090ba

[2/2] git commit: Revert [maven-release-plugin] prepare release v1.0.0-rc9

2014-05-20 Thread tdas
Revert [maven-release-plugin] prepare release v1.0.0-rc9 This reverts commit 920f947eb5a22a679c0c3186cf69ee75f6041c75. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0d988421 Tree:

[1/2] git commit: Revert [maven-release-plugin] prepare for next development iteration

2014-05-20 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 1c00f2a25 - 0d9884217 Revert [maven-release-plugin] prepare for next development iteration This reverts commit f8e611955096c5c1c7db5764b9d2851b1d295f0d. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

git commit: [Hotfix] Blacklisted flaky HiveCompatibility test

2014-05-20 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 0d9884217 - b4d93d38d [Hotfix] Blacklisted flaky HiveCompatibility test `lateral_view_outer` query sometimes returns a different set of 10 rows. Author: Tathagata Das tathagata.das1...@gmail.com Closes #838 from tdas/hive-test-fix2

git commit: [SPARK-1876] Windows fixes to deal with latest distribution layout changes

2014-05-19 Thread tdas
Repository: spark Updated Branches: refs/heads/master df0aa8353 - 7b70a7071 [SPARK-1876] Windows fixes to deal with latest distribution layout changes - Look for JARs in the right place - Launch examples the same way as on Unix - Load datanucleus JARs if they exist - Don't attempt to parse

git commit: SPARK-1878: Fix the incorrect initialization order

2014-05-19 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 111c121ae - 901102c1b SPARK-1878: Fix the incorrect initialization order JIRA: https://issues.apache.org/jira/browse/SPARK-1878 Author: zsxwing zsxw...@gmail.com Closes #822 from zsxwing/SPARK-1878 and squashes the following commits:

git commit: SPARK-1879. Increase MaxPermSize since some of our builds have many classes

2014-05-19 Thread tdas
Repository: spark Updated Branches: refs/heads/master 1811ba8cc - 5af99d761 SPARK-1879. Increase MaxPermSize since some of our builds have many classes See https://issues.apache.org/jira/browse/SPARK-1879 -- builds with Hadoop2 and Hive ran out of PermGen space in spark-shell, when those

git commit: SPARK-1689: Spark application should die when removed by Master

2014-05-19 Thread tdas
Repository: spark Updated Branches: refs/heads/master 6a2c5c610 - b0ce22e07 SPARK-1689: Spark application should die when removed by Master scheduler.error() will mask the error if there are active tasks. Being removed is a cataclysmic event for Spark applications, and should probably be

git commit: SPARK-1689: Spark application should die when removed by Master

2014-05-19 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 875c54fb3 - 78b6e6f1e SPARK-1689: Spark application should die when removed by Master scheduler.error() will mask the error if there are active tasks. Being removed is a cataclysmic event for Spark applications, and should probably be

[4/4] git commit: [SPARK-1874][MLLIB] Clean up MLlib sample data

2014-05-19 Thread tdas
[SPARK-1874][MLLIB] Clean up MLlib sample data 1. Added synthetic datasets for `MovieLensALS`, `LinearRegression`, `BinaryClassification`. 2. Embedded instructions in the help message of those example apps. Per discussion with Matei on the JIRA page, new example data is under `data/mllib`.

[1/4] [SPARK-1874][MLLIB] Clean up MLlib sample data

2014-05-19 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 78b6e6f1e - 1c6c8b5bd http://git-wip-us.apache.org/repos/asf/spark/blob/1c6c8b5b/data/mllib/sample_movielens_data.txt -- diff --git

git commit: [Spark 1877] ClassNotFoundException when loading RDD with serialized objects

2014-05-19 Thread tdas
...@u448a5b0a73d45358d94a.ant.amazon.com Closes #835 from tdas/SPARK-1877 and squashes the following commits: f346f71 [Tathagata Das] Addressed Patrick's comments. fee0c5d [Ghidireac] SPARK-1877: ClassNotFoundException when loading RDD with serialized objects (cherry picked from commit 52eb54d02403a3c37d84b9da7cc1cdb261048cf8) Signed

git commit: [Spark 1877] ClassNotFoundException when loading RDD with serialized objects

2014-05-19 Thread tdas
Closes #835 from tdas/SPARK-1877 and squashes the following commits: f346f71 [Tathagata Das] Addressed Patrick's comments. fee0c5d [Ghidireac] SPARK-1877: ClassNotFoundException when loading RDD with serialized objects Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git

git commit: Converted bang to ask to avoid scary warning when a block is removed

2014-05-15 Thread tdas
tathagata.das1...@gmail.com Closes #708 from tdas/bm-fix and squashes the following commits: ed4ef15 [Tathagata Das] Converted bang to ask to avoid scary warning when a block is removed. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit

git commit: Fixed streaming examples docs to use run-example instead of spark-submit

2014-05-14 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.0 69ec3149f - c7571d8c6 Fixed streaming examples docs to use run-example instead of spark-submit Pretty self-explanatory Author: Tathagata Das tathagata.das1...@gmail.com Closes #722 from tdas/example-fix and squashes the following

git commit: Converted bang to ask to avoid scary warning when a block is removed

2014-05-14 Thread tdas
tathagata.das1...@gmail.com Closes #708 from tdas/bm-fix and squashes the following commits: ed4ef15 [Tathagata Das] Converted bang to ask to avoid scary warning when a block is removed. (cherry picked from commit 32868f31f88aebd580ab9329dc51a30c26af7a74) Signed-off-by: Tathagata Das tathagata.das1

git commit: [SPARK-1504], [SPARK-1505], [SPARK-1558] Updated Spark Streaming guide

2014-05-05 Thread tdas
Closes #652 from tdas/doc-fix and squashes the following commits: cb4f4b7 [Tathagata Das] Possible fix for flaky graceful shutdown test. ab71f7f [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into doc-fix 8d6ff9b [Tathagata Das] Addded migration guide to Spark Streaming

git commit: [SPARK-1504], [SPARK-1505], [SPARK-1558] Updated Spark Streaming guide

2014-05-05 Thread tdas
...@gmail.com Closes #652 from tdas/doc-fix and squashes the following commits: cb4f4b7 [Tathagata Das] Possible fix for flaky graceful shutdown test. ab71f7f [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into doc-fix 8d6ff9b [Tathagata Das] Addded migration guide to Spark Streaming

git commit: [Spark-1382] Fix NPE in DStream.slice (updated version of #365)

2014-04-25 Thread tdas
: Tathagata Das tathagata.das1...@gmail.com Closes #562 from tdas/SPARK-1382 and squashes the following commits: e2962c1 [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into SPARK-1382 20968d9 [zsxwing] Replace Exception with SparkException in DStream e476651 [zsxwing] Merge remote

git commit: [SPARK-1592][streaming] Automatically remove streaming input blocks

2014-04-24 Thread tdas
Das tathagata.das1...@gmail.com Closes #512 from tdas/block-rdd-unpersist and squashes the following commits: d25e610 [Tathagata Das] Merge remote-tracking branch 'apache/master' into block-rdd-unpersist 5f46d69 [Tathagata Das] Merge remote-tracking branch 'apache/master' into block-rdd-unpersist

git commit: [SPARK-1592][streaming] Automatically remove streaming input blocks

2014-04-24 Thread tdas
: Tathagata Das tathagata.das1...@gmail.com Closes #512 from tdas/block-rdd-unpersist and squashes the following commits: d25e610 [Tathagata Das] Merge remote-tracking branch 'apache/master' into block-rdd-unpersist 5f46d69 [Tathagata Das] Merge remote-tracking branch 'apache/master' into block-rdd

git commit: [SPARK-1510] Spark Streaming metrics source for metrics system

2014-04-24 Thread tdas
Author: Tathagata Das tathagata.das1...@gmail.com Closes #545 from tdas/streaming-metrics and squashes the following commits: 034b443 [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into streaming-metrics fb3b0a5 [jerryshao] Modify according master update 21939f5 [jerryshao

git commit: [SPARK-1510] Spark Streaming metrics source for metrics system

2014-04-24 Thread tdas
...@intel.com Author: Tathagata Das tathagata.das1...@gmail.com Closes #545 from tdas/streaming-metrics and squashes the following commits: 034b443 [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into streaming-metrics fb3b0a5 [jerryshao] Modify according master update 21939f5

git commit: [SPARK-1617] and [SPARK-1618] Improvements to streaming ui and bug fix to socket receiver

2014-04-24 Thread tdas
cannot connect in the first attempt, it should try to restart after a delay. That was broken, as the thread that restarts (hence, stops) the receiver waited on Thread.join on itself! Author: Tathagata Das tathagata.das1...@gmail.com Closes #540 from tdas/streaming-ui-fix and squashes the following

git commit: [SPARK-1617] and [SPARK-1618] Improvements to streaming ui and bug fix to socket receiver

2014-04-24 Thread tdas
cannot connect in the first attempt, it should try to restart after a delay. That was broken, as the thread that restarts (hence, stops) the receiver waited on Thread.join on itself! Author: Tathagata Das tathagata.das1...@gmail.com Closes #540 from tdas/streaming-ui-fix and squashes

svn commit: r5003 - /dev/spark/spark-0.9.1/

2014-04-09 Thread tdas
Author: tdas Date: Wed Apr 9 19:48:15 2014 New Revision: 5003 Log: Moved Spark 0.9.1 from dev tree to release tree, within incubator/spark as a temporary place until www.apache.org/dist/spark is created. Removed: dev/spark/spark-0.9.1/

svn commit: r1586127 [2/2] - in /spark: ./ news/_posts/ releases/_posts/ site/ site/docs/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/streaming/

2014-04-09 Thread tdas
Modified: spark/site/releases/spark-release-0-5-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-5-0.html?rev=1586127r1=1586126r2=1586127view=diff == ---

svn commit: r1586167 [2/2] - in /spark/site/docs/0.9.1: ./ api/pyspark/

2014-04-09 Thread tdas
Modified: spark/site/docs/0.9.1/tuning.html URL: http://svn.apache.org/viewvc/spark/site/docs/0.9.1/tuning.html?rev=1586167r1=1586166r2=1586167view=diff == --- spark/site/docs/0.9.1/tuning.html (original) +++

svn commit: r1586169 - in /spark: releases/_posts/2014-04-09-spark-release-0-9-1.md site/docs/0.9.1/0.9.1-docs.tgz site/releases/spark-release-0-9-1.html

2014-04-09 Thread tdas
Author: tdas Date: Wed Apr 9 23:19:13 2014 New Revision: 1586169 URL: http://svn.apache.org/r1586169 Log: Updated 0.9.1 release notes Removed: spark/site/docs/0.9.1/0.9.1-docs.tgz Modified: spark/releases/_posts/2014-04-09-spark-release-0-9-1.md spark/site/releases/spark-release-0-9

svn commit: r1586197 - in /spark: releases/_posts/2014-04-09-spark-release-0-9-1.md site/releases/spark-release-0-9-1.html

2014-04-09 Thread tdas
Author: tdas Date: Thu Apr 10 02:17:44 2014 New Revision: 1586197 URL: http://svn.apache.org/r1586197 Log: Fixed typo Modified: spark/releases/_posts/2014-04-09-spark-release-0-9-1.md spark/site/releases/spark-release-0-9-1.html Modified: spark/releases/_posts/2014-04-09-spark-release-0

svn commit: r1585872 - in /spark/site/docs/0.9.1: ./ api/ api/bagel/ api/bagel/index/ api/bagel/lib/ api/bagel/org/ api/bagel/org/apache/ api/bagel/org/apache/spark/ api/bagel/org/apache/spark/bagel/

2014-04-08 Thread tdas
Author: tdas Date: Wed Apr 9 01:34:23 2014 New Revision: 1585872 URL: http://svn.apache.org/r1585872 Log: Added 0.9.1 docs [This commit notification would consist of 309 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

Git Push Summary

2014-04-08 Thread tdas
Repository: spark Updated Tags: refs/tags/v0.9.1 [created] 4c43182b6

[1/3] git commit: Revert [maven-release-plugin] prepare for next development iteration

2014-03-26 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-0.9 49016046d - 348f54b9c Revert [maven-release-plugin] prepare for next development iteration This reverts commit 1f785d46e4e3df716dc836e38933dc0a30028496. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

[2/3] git commit: Revert [maven-release-plugin] prepare release v0.9.1-rc2

2014-03-26 Thread tdas
Revert [maven-release-plugin] prepare release v0.9.1-rc2 This reverts commit 1197280acf1322165301259dd825f44e22a323bc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ea5da04f Tree:

git commit: [maven-release-plugin] prepare release v0.9.1-rc3

2014-03-26 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-0.9 348f54b9c - 4c43182b6 [maven-release-plugin] prepare release v0.9.1-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4c43182b Tree:

git commit: Bumped versions to Spark 0.9.1

2014-03-20 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-0.9 c6630d363 - 8a882eff9 Bumped versions to Spark 0.9.1 Self explanatory! Author: Tathagata Das tathagata.das1...@gmail.com Closes #190 from tdas/branch-0.9-version-bump and squashes the following commits: 34576ee [Tathagata Das

git commit: [SPARK-1275] Made dev/run-tests executable.

2014-03-19 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-0.9 72875b29b - a4eef655c [SPARK-1275] Made dev/run-tests executable. This was causing Jenkins tests to fail for PRs against branch 0.9. Author: Tathagata Das tathagata.das1...@gmail.com Closes #178 from tdas/branch-0.9-fix and squashes

<    4   5   6   7   8   9