spark git commit: [SPARK-6910] [SQL] Support for pushing predicates down to metastore for partition pruning

2015-07-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master b7bcbe25f - 408b384de [SPARK-6910] [SQL] Support for pushing predicates down to metastore for partition pruning This PR supersedes my old one #6921. Since my patch has changed quite a bit, I am opening a new PR to make it easier to

spark git commit: [SPARK-8954] [BUILD] Remove unneeded deb repository from Dockerfile to fix build error in docker.

2015-07-13 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 79c35826e - 5c41691fe [SPARK-8954] [BUILD] Remove unneeded deb repository from Dockerfile to fix build error in docker. [SPARK-8954] [Build] 1. Remove unneeded deb repository from Dockerfile to fix build error in docker. 2. Remove

spark git commit: [SPARK-8991] [ML] Update SharedParamsCodeGen's Generated Documentation

2015-07-13 Thread meng
Repository: spark Updated Branches: refs/heads/master 5c41691fe - 714fc55f4 [SPARK-8991] [ML] Update SharedParamsCodeGen's Generated Documentation Removed private[ml] from Generated documentation Author: Vinod K C vinod...@huawei.com Closes #7367 from vinodkc/fix_sharedparmascodegen and

spark git commit: [SPARK-8950] [WEBUI] Correct the calculation of SchedulerDelay in StagePage

2015-07-13 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/master 9b62e9375 - 5ca26fb64 [SPARK-8950] [WEBUI] Correct the calculation of SchedulerDelay in StagePage In StagePage, the SchedulerDelay is calculated as totalExecutionTime - executorRunTime - executorOverhead - gettingResultTime. But the

spark git commit: [SPARK-8706] [PYSPARK] [PROJECT INFRA] Add pylint checks to PySpark

2015-07-13 Thread davies
Repository: spark Updated Branches: refs/heads/master 7f487c8bd - 9b62e9375 [SPARK-8706] [PYSPARK] [PROJECT INFRA] Add pylint checks to PySpark This adds Pylint checks to PySpark. For now this lazy installs using easy_install to /dev/pylint (similar to the pep8 script). We still need to

spark git commit: Revert [SPARK-8706] [PYSPARK] [PROJECT INFRA] Add pylint checks to PySpark

2015-07-13 Thread davies
Repository: spark Updated Branches: refs/heads/master 5ca26fb64 - 79c35826e Revert [SPARK-8706] [PYSPARK] [PROJECT INFRA] Add pylint checks to PySpark This reverts commit 9b62e9375f032548d386aec7468e3d0f7c6da7b2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-8596] Add module for rstudio link to spark

2015-07-13 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 6b8994383 - a5bc803b7 [SPARK-8596] Add module for rstudio link to spark shivaram, added module for rstudio install Author: Vincent D. Warmerdam vincentwarmer...@gmail.com Closes #7366 from koaning/rstudio-install and squashes the

spark git commit: [SPARK-8636] [SQL] Fix equalNullSafe comparison

2015-07-13 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 714fc55f4 - 4c797f2b0 [SPARK-8636] [SQL] Fix equalNullSafe comparison Author: Vinod K C vinod...@huawei.com Closes #7040 from vinodkc/fix_CaseKeyWhen_equalNullSafe and squashes the following commits: be5e641 [Vinod K C] Renamed

spark git commit: [SPARK-8533] [STREAMING] Upgrade Flume to 1.6.0

2015-07-13 Thread tdas
Repository: spark Updated Branches: refs/heads/master 4c797f2b0 - 0aed38e44 [SPARK-8533] [STREAMING] Upgrade Flume to 1.6.0 Author: Hari Shreedharan hshreedha...@apache.org Closes #6939 from harishreedharan/upgrade-flume-1.6.0 and squashes the following commits: 94b80ae [Hari Shreedharan]

spark git commit: [SPARK-8743] [STREAMING] Deregister Codahale metrics for streaming when StreamingContext is closed

2015-07-13 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.4 898e5f76f - 50607eca5 [SPARK-8743] [STREAMING] Deregister Codahale metrics for streaming when StreamingContext is closed The issue link: https://issues.apache.org/jira/browse/SPARK-8743 Deregister Codahale metrics for streaming when

spark git commit: [SPARK-6797] [SPARKR] Add support for YARN cluster mode.

2015-07-13 Thread shivaram
Repository: spark Updated Branches: refs/heads/master a5bc803b7 - 7f487c8bd [SPARK-6797] [SPARKR] Add support for YARN cluster mode. This PR enables SparkR to dynamically ship the SparkR binary package to the AM node in YARN cluster mode, thus it is no longer required that the SparkR

spark git commit: [SPARK-8743] [STREAMING] Deregister Codahale metrics for streaming when StreamingContext is closed

2015-07-13 Thread tdas
Repository: spark Updated Branches: refs/heads/master 0aed38e44 - b7bcbe25f [SPARK-8743] [STREAMING] Deregister Codahale metrics for streaming when StreamingContext is closed The issue link: https://issues.apache.org/jira/browse/SPARK-8743 Deregister Codahale metrics for streaming when

spark git commit: [SPARK-8203] [SPARK-8204] [SQL] conditional function: least/greatest

2015-07-13 Thread davies
Repository: spark Updated Branches: refs/heads/master 20b474335 - 92540d22e [SPARK-8203] [SPARK-8204] [SQL] conditional function: least/greatest chenghao-intel zhichao-li qiansl127 Author: Daoyuan Wang daoyuan.w...@intel.com Closes #6851 from adrian-wang/udflg and squashes the following

spark git commit: [SPARK-8944][SQL] Support casting between IntervalType and StringType

2015-07-13 Thread rxin
Repository: spark Updated Branches: refs/heads/master 92540d22e - 6b8994383 [SPARK-8944][SQL] Support casting between IntervalType and StringType Author: Wenchen Fan cloud0...@outlook.com Closes #7355 from cloud-fan/fromString and squashes the following commits: 3bbb9d6 [Wenchen Fan] fix