spark git commit: [SPARK-19584][SS][DOCS] update structured streaming documentation around batch mode

Repository: spark Updated Branches: refs/heads/branch-2.1 7763b0b8b -> 8ee4ec812 [SPARK-19584][SS][DOCS] update structured streaming documentation around batch mode ## What changes were proposed in this pull request? Revision to structured-streaming-kafka-integration.md to reflect new Batch

spark git commit: [SPARK-19584][SS][DOCS] update structured streaming documentation around batch mode

Repository: spark Updated Branches: refs/heads/master f48c5a57d -> 447b2b530 [SPARK-19584][SS][DOCS] update structured streaming documentation around batch mode ## What changes were proposed in this pull request? Revision to structured-streaming-kafka-integration.md to reflect new Batch

spark git commit: [SPARK-19318][SQL] Fix to treat JDBC connection properties specified by the user in case-sensitive manner.

Repository: spark Updated Branches: refs/heads/master da7aef7a0 -> f48c5a57d [SPARK-19318][SQL] Fix to treat JDBC connection properties specified by the user in case-sensitive manner. ## What changes were proposed in this pull request? The reason for test failure is that the property

spark git commit: [SPARK-16475][SQL] Broadcast hint for SQL Queries

Repository: spark Updated Branches: refs/heads/master a3626ca33 -> da7aef7a0 [SPARK-16475][SQL] Broadcast hint for SQL Queries ## What changes were proposed in this pull request? This pull request introduces a simple hint infrastructure to SQL and implements broadcast join hint using the

spark git commit: [SPARK-19387][SPARKR] Tests do not run with SparkR source package in CRAN check

Repository: spark Updated Branches: refs/heads/master ab9872db1 -> a3626ca33 [SPARK-19387][SPARKR] Tests do not run with SparkR source package in CRAN check ## What changes were proposed in this pull request? - this is cause by changes in SPARK-18444, SPARK-18643 that we no longer install

spark git commit: [SPARK-19387][SPARKR] Tests do not run with SparkR source package in CRAN check

Repository: spark Updated Branches: refs/heads/branch-2.1 f837ced4c -> 7763b0b8b [SPARK-19387][SPARKR] Tests do not run with SparkR source package in CRAN check ## What changes were proposed in this pull request? - this is cause by changes in SPARK-18444, SPARK-18643 that we no longer

spark git commit: [SPARK-19501][YARN] Reduce the number of HDFS RPCs during YARN deployment

Repository: spark Updated Branches: refs/heads/branch-2.0 f50c4372c -> 29268125e [SPARK-19501][YARN] Reduce the number of HDFS RPCs during YARN deployment ## What changes were proposed in this pull request? As discussed in [JIRA](https://issues.apache.org/jira/browse/SPARK-19501), this

spark git commit: [SPARK-19501][YARN] Reduce the number of HDFS RPCs during YARN deployment

Repository: spark Updated Branches: refs/heads/branch-2.1 c8113b0ee -> f837ced4c [SPARK-19501][YARN] Reduce the number of HDFS RPCs during YARN deployment ## What changes were proposed in this pull request? As discussed in [JIRA](https://issues.apache.org/jira/browse/SPARK-19501), this

spark git commit: [SPARK-19501][YARN] Reduce the number of HDFS RPCs during YARN deployment

Repository: spark Updated Branches: refs/heads/master f776e3b42 -> ab9872db1 [SPARK-19501][YARN] Reduce the number of HDFS RPCs during YARN deployment ## What changes were proposed in this pull request? As discussed in [JIRA](https://issues.apache.org/jira/browse/SPARK-19501), this patch

spark git commit: [SPARK-19529][BRANCH-1.6] Backport PR #16866 to branch-1.6

Repository: spark Updated Branches: refs/heads/branch-1.6 e78138a43 -> a50ef3d9a [SPARK-19529][BRANCH-1.6] Backport PR #16866 to branch-1.6 ## What changes were proposed in this pull request? This PR backports PR #16866 to branch-1.6 ## How was this patch tested? Existing tests. Author:

spark git commit: [SPARK-19571][R] Fix SparkR test break on Windows via AppVeyor

Repository: spark Updated Branches: refs/heads/master 7b64f7aa0 -> f776e3b42 [SPARK-19571][R] Fix SparkR test break on Windows via AppVeyor ## What changes were proposed in this pull request? It seems wintuils for Hadoop 2.6.5 not exiting for now in https://github.com/steveloughran/winutils

spark git commit: [SPARK-18541][PYTHON] Add metadata parameter to pyspark.sql.Column.alias()

Repository: spark Updated Branches: refs/heads/master e0eeb0f89 -> 7b64f7aa0 [SPARK-18541][PYTHON] Add metadata parameter to pyspark.sql.Column.alias() ## What changes were proposed in this pull request? Add a `metadata` keyword parameter to `pyspark.sql.Column.alias()` to allow users to

spark git commit: [SPARK-19162][PYTHON][SQL] UserDefinedFunction should validate that func is callable

Repository: spark Updated Branches: refs/heads/master 9c4405e8e -> e0eeb0f89 [SPARK-19162][PYTHON][SQL] UserDefinedFunction should validate that func is callable ## What changes were proposed in this pull request? UDF constructor checks if `func` argument is callable and if it is not, fails

spark git commit: [SPARK-19453][PYTHON][SQL][DOC] Correct and extend DataFrame.replace docstring

Repository: spark Updated Branches: refs/heads/master 457850e6f -> 9c4405e8e [SPARK-19453][PYTHON][SQL][DOC] Correct and extend DataFrame.replace docstring ## What changes were proposed in this pull request? - Provides correct description of the semantics of a `dict` argument passed as

[2/2] spark git commit: [SPARK-19589][SQL] Removal of SQLGEN files

[SPARK-19589][SQL] Removal of SQLGEN files ### What changes were proposed in this pull request? SQLGen is removed. Thus, the generated files should be removed too. ### How was this patch tested? N/A Author: Xiao Li Closes #16921 from gatorsmile/removeSQLGenFiles.

[1/2] spark git commit: [SPARK-19589][SQL] Removal of SQLGEN files

Repository: spark Updated Branches: refs/heads/master 9b5e460a9 -> 457850e6f http://git-wip-us.apache.org/repos/asf/spark/blob/457850e6/sql/hive/src/test/resources/sqlgen/rollup_cube_7_3.sql -- diff --git