spark git commit: [SPARK-17301][SQL] Remove unused classTag field from AtomicType base class

2016-08-29 Thread rxin
Repository: spark Updated Branches: refs/heads/master 736a7911c -> 48b459ddd [SPARK-17301][SQL] Remove unused classTag field from AtomicType base class There's an unused `classTag` val in the AtomicType base class which is causing unnecessary slowness in deserialization because it needs to

spark git commit: [SPARK-17301][SQL] Remove unused classTag field from AtomicType base class

2016-08-29 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 976a43dbf -> 59032570f [SPARK-17301][SQL] Remove unused classTag field from AtomicType base class There's an unused `classTag` val in the AtomicType base class which is causing unnecessary slowness in deserialization because it needs

spark git commit: [SPARK-16581][SPARKR] Make JVM backend calling functions public

2016-08-29 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 3d283f6c9 -> 976a43dbf [SPARK-16581][SPARKR] Make JVM backend calling functions public ## What changes were proposed in this pull request? This change exposes a public API in SparkR to create objects, call methods on the Spark driver

spark git commit: [SPARK-16581][SPARKR] Make JVM backend calling functions public

2016-08-29 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 48caec251 -> 736a7911c [SPARK-16581][SPARKR] Make JVM backend calling functions public ## What changes were proposed in this pull request? This change exposes a public API in SparkR to create objects, call methods on the Spark driver JVM

spark git commit: [SPARK-17063] [SQL] Improve performance of MSCK REPAIR TABLE with Hive metastore

2016-08-29 Thread davies
Repository: spark Updated Branches: refs/heads/branch-2.0 eec03718d -> 3d283f6c9 [SPARK-17063] [SQL] Improve performance of MSCK REPAIR TABLE with Hive metastore This PR split the the single `createPartitions()` call into smaller batches, which could prevent Hive metastore from OOM (caused

spark git commit: [SPARK-17063] [SQL] Improve performance of MSCK REPAIR TABLE with Hive metastore

2016-08-29 Thread davies
Repository: spark Updated Branches: refs/heads/master 6a0fda2c0 -> 48caec251 [SPARK-17063] [SQL] Improve performance of MSCK REPAIR TABLE with Hive metastore ## What changes were proposed in this pull request? This PR split the the single `createPartitions()` call into smaller batches,

spark git commit: [SPARKR][MINOR] Fix LDA doc

2016-08-29 Thread meng
Repository: spark Updated Branches: refs/heads/master 08913ce00 -> 6a0fda2c0 [SPARKR][MINOR] Fix LDA doc ## What changes were proposed in this pull request? This PR tries to fix the name of the `SparkDataFrame` used in the example. Also, it gives a reference url of an example data file so

spark-website git commit: Add Abraham Zhan to 2.0.0 contribs; wrap and dedupe the list.

2016-08-29 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 9700f2f4a -> d37a3afce Add Abraham Zhan to 2.0.0 contribs; wrap and dedupe the list. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/d37a3afc

spark git commit: fixed a typo

2016-08-29 Thread srowen
Repository: spark Updated Branches: refs/heads/master 1a48c0047 -> 08913ce00 fixed a typo idempotant -> idempotent Author: Seigneurin, Alexis (CONT) Closes #14833 from aseigneurin/fix-typo. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [BUILD] Closes some stale PRs.

2016-08-29 Thread srowen
Repository: spark Updated Branches: refs/heads/master 095862a3c -> 1a48c0047 [BUILD] Closes some stale PRs. ## What changes were proposed in this pull request? Closes #10995 Closes #13658 Closes #14505 Closes #14536 Closes #12753 Closes #14449 Closes #12694 Closes #12695 Closes #14810 Closes