spark git commit: [SPARK-20614][PROJECT INFRA] Use the same log4j configuration with Jenkins in AppVeyor

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 5d75b14bf -> b433acae7 [SPARK-20614][PROJECT INFRA] Use the same log4j configuration with Jenkins in AppVeyor ## What changes were proposed in this pull request? Currently, there are flooding logs in AppVeyor (in the console). This has

spark git commit: [SPARK-20208][DOCS][FOLLOW-UP] Add FP-Growth to SparkR programming guide

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 1d9b7a74a -> 423a78625 [SPARK-20208][DOCS][FOLLOW-UP] Add FP-Growth to SparkR programming guide ## What changes were proposed in this pull request? Add `spark.fpGrowth` to SparkR programming guide. ## How was this patch tested?

spark git commit: [SPARK-20616] RuleExecutor logDebug of batch results should show diff to start of batch

2017-05-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master b31648c08 -> 5d75b14bf [SPARK-20616] RuleExecutor logDebug of batch results should show diff to start of batch ## What changes were proposed in this pull request? Due to a likely typo, the logDebug msg printing the diff of query plans

spark git commit: [SPARK-20616] RuleExecutor logDebug of batch results should show diff to start of batch

2017-05-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.2 f59c74a94 -> 1d9b7a74a [SPARK-20616] RuleExecutor logDebug of batch results should show diff to start of batch ## What changes were proposed in this pull request? Due to a likely typo, the logDebug msg printing the diff of query

spark git commit: [SPARK-20616] RuleExecutor logDebug of batch results should show diff to start of batch

2017-05-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 704b249b6 -> a1112c615 [SPARK-20616] RuleExecutor logDebug of batch results should show diff to start of batch ## What changes were proposed in this pull request? Due to a likely typo, the logDebug msg printing the diff of query

spark git commit: [SPARK-20132][DOCS] Add documentation for column string functions

2017-05-05 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.2 24fffacad -> f59c74a94 [SPARK-20132][DOCS] Add documentation for column string functions ## What changes were proposed in this pull request? Add docstrings to column.py for the Column functions `rlike`, `like`, `startswith`, and

spark git commit: [SPARK-20557][SQL] Support for db column type TIMESTAMP WITH TIME ZONE

2017-05-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/master bd5788287 -> b31648c08 [SPARK-20557][SQL] Support for db column type TIMESTAMP WITH TIME ZONE ## What changes were proposed in this pull request? SparkSQL can now read from a database table with column type [TIMESTAMP WITH TIME

spark git commit: [SPARK-20603][SS][TEST] Set default number of topic partitions to 1 to reduce the load

2017-05-05 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 2a7f5dae5 -> 704b249b6 [SPARK-20603][SS][TEST] Set default number of topic partitions to 1 to reduce the load ## What changes were proposed in this pull request? I checked the logs of

spark git commit: [SPARK-20603][SS][TEST] Set default number of topic partitions to 1 to reduce the load

2017-05-05 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 f71aea6a0 -> 24fffacad [SPARK-20603][SS][TEST] Set default number of topic partitions to 1 to reduce the load ## What changes were proposed in this pull request? I checked the logs of

spark git commit: [SPARK-20603][SS][TEST] Set default number of topic partitions to 1 to reduce the load

2017-05-05 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 41439fd52 -> bd5788287 [SPARK-20603][SS][TEST] Set default number of topic partitions to 1 to reduce the load ## What changes were proposed in this pull request? I checked the logs of

spark git commit: [SPARK-20381][SQL] Add SQL metrics of numOutputRows for ObjectHashAggregateExec

2017-05-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/master b9ad2d191 -> 41439fd52 [SPARK-20381][SQL] Add SQL metrics of numOutputRows for ObjectHashAggregateExec ## What changes were proposed in this pull request? ObjectHashAggregateExec is missing numOutputRows, add this metrics for it. ## How

spark git commit: [SPARK-20381][SQL] Add SQL metrics of numOutputRows for ObjectHashAggregateExec

2017-05-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 1fa3c86a7 -> f71aea6a0 [SPARK-20381][SQL] Add SQL metrics of numOutputRows for ObjectHashAggregateExec ## What changes were proposed in this pull request? ObjectHashAggregateExec is missing numOutputRows, add this metrics for it. ##

spark git commit: [SPARK-20613] Remove excess quotes in Windows executable

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.1 179f5370e -> 2a7f5dae5 [SPARK-20613] Remove excess quotes in Windows executable ## What changes were proposed in this pull request? Quotes are already added to the RUNNER variable on line 54. There is no need to put quotes on line

spark git commit: [SPARK-20613] Remove excess quotes in Windows executable

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 dbb54a7b3 -> 1fa3c86a7 [SPARK-20613] Remove excess quotes in Windows executable ## What changes were proposed in this pull request? Quotes are already added to the RUNNER variable on line 54. There is no need to put quotes on line

spark git commit: [SPARK-20613] Remove excess quotes in Windows executable

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 9064f1b04 -> b9ad2d191 [SPARK-20613] Remove excess quotes in Windows executable ## What changes were proposed in this pull request? Quotes are already added to the RUNNER variable on line 54. There is no need to put quotes on line 67. If

spark git commit: [SPARK-20495][SQL][CORE] Add StorageLevel to cacheTable API

2017-05-05 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 5773ab121 -> 9064f1b04 [SPARK-20495][SQL][CORE] Add StorageLevel to cacheTable API ## What changes were proposed in this pull request? Currently cacheTable API only supports MEMORY_AND_DISK. This PR adds additional API to take different

spark git commit: [SPARK-20546][DEPLOY] spark-class gets syntax error in posix mode

2017-05-05 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 d10b0f654 -> 179f5370e [SPARK-20546][DEPLOY] spark-class gets syntax error in posix mode ## What changes were proposed in this pull request? Updated spark-class to turn off posix mode so the process substitution doesn't cause a

spark git commit: [SPARK-20546][DEPLOY] spark-class gets syntax error in posix mode

2017-05-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master 37cdf077c -> 5773ab121 [SPARK-20546][DEPLOY] spark-class gets syntax error in posix mode ## What changes were proposed in this pull request? Updated spark-class to turn off posix mode so the process substitution doesn't cause a syntax

spark git commit: [SPARK-20546][DEPLOY] spark-class gets syntax error in posix mode

2017-05-05 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 7cb566abc -> dbb54a7b3 [SPARK-20546][DEPLOY] spark-class gets syntax error in posix mode ## What changes were proposed in this pull request? Updated spark-class to turn off posix mode so the process substitution doesn't cause a

spark git commit: [SPARK-19660][SQL] Replace the deprecated property name fs.default.name to fs.defaultFS that newly introduced

2017-05-05 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 c8756288d -> 7cb566abc [SPARK-19660][SQL] Replace the deprecated property name fs.default.name to fs.defaultFS that newly introduced ## What changes were proposed in this pull request? Replace the deprecated property name

spark git commit: [SPARK-19660][SQL] Replace the deprecated property name fs.default.name to fs.defaultFS that newly introduced

2017-05-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4411ac705 -> 37cdf077c [SPARK-19660][SQL] Replace the deprecated property name fs.default.name to fs.defaultFS that newly introduced ## What changes were proposed in this pull request? Replace the deprecated property name

spark git commit: [INFRA] Close stale PRs

2017-05-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0d16faab9 -> 4411ac705 [INFRA] Close stale PRs ## What changes were proposed in this pull request? This PR proposes to close a stale PR, several PRs suggested to be closed by a committer and obviously inappropriate PRs. Closes #9