[2/2] git commit: Merge pull request #364 from pwendell/fix

2014-01-08 Thread pwendell
Merge pull request #364 from pwendell/fix Fixing config option "retained_stages" => "retainedStages". This is a very esoteric option and it's out of sync with the style we use. So it seems fitting to fix it for 0.9.0. Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit:

[1/2] git commit: Fixing config option "retained_stages" => "retainedStages".

2014-01-08 Thread pwendell
Updated Branches: refs/heads/master 04d83fc37 -> dceedb466 Fixing config option "retained_stages" => "retainedStages". This is a very esoteric option and it's out of sync with the style we use. So it seems fitting to fix it for 0.9.0. Project: http://git-wip-us.apache.org/repos/asf/incubator

[1/2] git commit: fix make-distribution.sh show version: command not found

2014-01-08 Thread rxin
Updated Branches: refs/heads/master 56ebfeaa5 -> 04d83fc37 fix make-distribution.sh show version: command not found Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/cf4aaf92 Tree: http://git-wip-us.apach

[2/2] git commit: Merge pull request #360 from witgo/master

2014-01-08 Thread rxin
Merge pull request #360 from witgo/master fix make-distribution.sh show version: command not found Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/04d83fc3 Tree: http://git-wip-us.apache.org/repos/asf/incu

[1/3] git commit: Set boolean param name for two files call to SparkHadoopMapReduceUtil.newTaskAttemptID to make it clear which param being set.

2014-01-08 Thread rxin
Updated Branches: refs/heads/master bdeaeafbd -> 56ebfeaa5 Set boolean param name for two files call to SparkHadoopMapReduceUtil.newTaskAttemptID to make it clear which param being set. Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/

[2/3] git commit: Resolve PR review over 100 chars

2014-01-08 Thread rxin
Resolve PR review over 100 chars Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/aa56585d Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/aa56585d Diff: http://git-wip-us.apache.org/repos/

[3/3] git commit: Merge pull request #357 from hsaputra/set_boolean_paramname

2014-01-08 Thread rxin
Merge pull request #357 from hsaputra/set_boolean_paramname Set boolean param name for call to SparkHadoopMapReduceUtil.newTaskAttemptID Set boolean param name for call to SparkHadoopMapReduceUtil.newTaskAttemptID to make it clear which param being set. Project: http://git-wip-us.apache.org/re

[2/2] git commit: Merge pull request #358 from pwendell/add-cdh

2014-01-08 Thread pwendell
Merge pull request #358 from pwendell/add-cdh Add CDH Repository to Maven Build At some point this was removed from the Maven build... so I'm adding it back. It's needed for the Hadoop2 tests we run on Jenkins and it's also included in the SBT build. Project: http://git-wip-us.apache.org/repo

[1/2] git commit: Add CDH Repository to Maven Build

2014-01-08 Thread pwendell
Updated Branches: refs/heads/master 5cae05f59 -> bdeaeafbd Add CDH Repository to Maven Build Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/3209a86f Tree: http://git-wip-us.apache.org/repos/asf/incubat

[2/2] git commit: Merge pull request #356 from hsaputra/remove_deprecated_cleanup_method

2014-01-08 Thread rxin
Merge pull request #356 from hsaputra/remove_deprecated_cleanup_method Remove calls to deprecated mapred's OutputCommitter.cleanupJob Since Hadoop 1.0.4 the mapred OutputCommitter.commitJob should do cleanup job via call to OutputCommitter.cleanupJob, Remove SparkHadoopWriter.cleanup since it i

[1/2] git commit: Remove calls to deprecated mapred's OutputCommitter.cleanupJob because since Hadoop 1.0.4 the mapred OutputCommitter.commitJob should do cleanup job.

2014-01-08 Thread rxin
Updated Branches: refs/heads/master 6eef78d76 -> 5cae05f59 Remove calls to deprecated mapred's OutputCommitter.cleanupJob because since Hadoop 1.0.4 the mapred OutputCommitter.commitJob should do cleanup job. In fact the implementation of mapred OutputCommitter.commitJob looks like this: p

[3/3] git commit: Merge pull request #345 from colorant/yarn

2014-01-08 Thread tgraves
Merge pull request #345 from colorant/yarn support distributing extra files to worker for yarn client mode So that user doesn't need to package all dependency into one assemble jar as spark app jar Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.a

[2/3] git commit: Export --file for YarnClient mode to support sending extra files to worker on yarn cluster

2014-01-08 Thread tgraves
Export --file for YarnClient mode to support sending extra files to worker on yarn cluster Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/67af8031 Tree: http://git-wip-us.apache.org/repos/asf/incubator-sp

[1/3] git commit: Minor typo fix for yarn client

2014-01-08 Thread tgraves
Updated Branches: refs/heads/master bb6a39a68 -> 6eef78d76 Minor typo fix for yarn client Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/da4694a0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-