git commit: [SPARK-2172] PySpark cannot import mllib modules in YARN-client mode

2014-06-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4a346e242 - 441cdcca6 [SPARK-2172] PySpark cannot import mllib modules in YARN-client mode Include pyspark/mllib python sources as resources in the mllib.jar. This way they will be included in the final assembly Author: Szul, Piotr

git commit: [SPARK-2254] [SQL] ScalaRefection should mark primitive types as non-nullable.

2014-06-26 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.0 c445b3af3 - 47f8829e0 [SPARK-2254] [SQL] ScalaRefection should mark primitive types as non-nullable. Author: Takuya UESHIN ues...@happy-camper.st Closes #1193 from ueshin/issues/SPARK-2254 and squashes the following commits: cfd6088

git commit: [SPARK-2254] [SQL] ScalaRefection should mark primitive types as non-nullable.

2014-06-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 441cdcca6 - e4899a253 [SPARK-2254] [SQL] ScalaRefection should mark primitive types as non-nullable. Author: Takuya UESHIN ues...@happy-camper.st Closes #1193 from ueshin/issues/SPARK-2254 and squashes the following commits: cfd6088

git commit: Remove use of spark.worker.instances

2014-06-26 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-1.0 47f8829e0 - 2d3080855 Remove use of spark.worker.instances spark.worker.instances was added as part of this commit: https://github.com/apache/spark/commit/1617816090e7b20124a512a43860a21232ebf511 My understanding is that

git commit: [SPARK-2251] fix concurrency issues in random sampler (branch-1.0)

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 2d3080855 - 45bf91025 [SPARK-2251] fix concurrency issues in random sampler (branch-1.0) The following code is very likely to throw an exception: ~~~ val rdd = sc.parallelize(0 until 111, 10).sample(false, 0.1) rdd.zip(rdd).count()

git commit: [SPARK-2295] [SQL] Make JavaBeans nullability stricter.

2014-06-26 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.0 45bf91025 - a7bebd14d [SPARK-2295] [SQL] Make JavaBeans nullability stricter. Author: Takuya UESHIN ues...@happy-camper.st Closes #1235 from ueshin/issues/SPARK-2295 and squashes the following commits: 201c508 [Takuya UESHIN] Make

git commit: [SPARK-2286][UI] Report exception/errors for failed tasks that are not ExceptionFailure

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 32a1ad753 - 6587ef7c1 [SPARK-2286][UI] Report exception/errors for failed tasks that are not ExceptionFailure Also added inline doc for each TaskEndReason. Author: Reynold Xin r...@apache.org Closes #1225 from rxin/SPARK-2286 and

git commit: [SPARK-2286][UI] Report exception/errors for failed tasks that are not ExceptionFailure

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 a7bebd14d - ddf9a7841 [SPARK-2286][UI] Report exception/errors for failed tasks that are not ExceptionFailure Also added inline doc for each TaskEndReason. Author: Reynold Xin r...@apache.org Closes #1225 from rxin/SPARK-2286 and

git commit: Updating versions for 1.0.1 release

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 ddf9a7841 - 43ba1ab64 Updating versions for 1.0.1 release Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/43ba1ab6 Tree:

git commit: Small error in previous commit

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 43ba1ab64 - c23bfd7de Small error in previous commit Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c23bfd7d Tree:

git commit: Fixing AWS instance type information based upon current EC2 data

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 6587ef7c1 - 62d4a0fa9 Fixing AWS instance type information based upon current EC2 data Fixed a problem in previous file in which some information regarding AWS instance types were wrong. Such information was updated base upon current AWS

git commit: Fixing AWS instance type information based upon current EC2 data

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 c23bfd7de - 0bc83210d Fixing AWS instance type information based upon current EC2 data Fixed a problem in previous file in which some information regarding AWS instance types were wrong. Such information was updated base upon current

Git Push Summary

2014-06-26 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.0.0 2f1dc868e - c69d97cdb

git commit: CHANGES.txt for release 1.0.1

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 0bc83210d - 341e5c6c1 CHANGES.txt for release 1.0.1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/341e5c6c Tree:

Git Push Summary

2014-06-26 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.0.1-rc1 [created] 2a9114542

git commit: [maven-release-plugin] prepare release v1.0.1-rc1

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 341e5c6c1 - 7feeda3d7 [maven-release-plugin] prepare release v1.0.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7feeda3d Tree:

git commit: [maven-release-plugin] prepare for next development iteration

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 7feeda3d7 - ea1a455a7 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ea1a455a Tree:

git commit: Strip '@' symbols when merging pull requests.

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 62d4a0fa9 - f1f7385a5 Strip '@' symbols when merging pull requests. Currently all of the commits with 'X' in them cause person X to receive e-mails every time someone makes a public fork of Spark. marmbrus who requested this. Author:

git commit: Removed throwable field from FetchFailedException and added MetadataFetchFailedException

2014-06-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 981bde9b0 - bf578deaf Removed throwable field from FetchFailedException and added MetadataFetchFailedException FetchFailedException used to have a Throwable field, but in reality we never propagate any of the throwable/exceptions back to

git commit: [SPARK-2297][UI] Make task attempt and speculation more explicit in UI.

2014-06-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master bf578deaf - d1636dd72 [SPARK-2297][UI] Make task attempt and speculation more explicit in UI. New UI: ![screen shot 2014-06-26 at 1 43 52

git commit: [SPARK-2251] fix concurrency issues in random sampler

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/master d1636dd72 - c23f5db32 [SPARK-2251] fix concurrency issues in random sampler The following code is very likely to throw an exception: ~~~ val rdd = sc.parallelize(0 until 111, 10).sample(false, 0.1) rdd.zip(rdd).count() ~~~ because the

git commit: SPARK-2181:The keys for sorting the columns of Executor page in SparkUI are incorrect

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/master c23f5db32 - 18f29b96c SPARK-2181:The keys for sorting the columns of Executor page in SparkUI are incorrect Author: witgo wi...@qq.com Closes #1135 from witgo/SPARK-2181 and squashes the following commits: 39dad90 [witgo] The keys for

git commit: SPARK-2181:The keys for sorting the columns of Executor page in SparkUI are incorrect

2014-06-26 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 ea1a455a7 - fb61928cf SPARK-2181:The keys for sorting the columns of Executor page in SparkUI are incorrect Author: witgo wi...@qq.com Closes #1135 from witgo/SPARK-2181 and squashes the following commits: 39dad90 [witgo] The keys