spark git commit: [SPARK-15863][SQL][DOC][FOLLOW-UP] Update SQL programming guide.

Repository: spark Updated Branches: refs/heads/master a0da854fb -> dd6b7dbe7 [SPARK-15863][SQL][DOC][FOLLOW-UP] Update SQL programming guide. ## What changes were proposed in this pull request? This PR makes several updates to SQL programming guide. Author: Yin Huai

spark git commit: [SPARK-15863][SQL][DOC][FOLLOW-UP] Update SQL programming guide.

Repository: spark Updated Branches: refs/heads/branch-2.0 7177e1843 -> af70ad028 [SPARK-15863][SQL][DOC][FOLLOW-UP] Update SQL programming guide. ## What changes were proposed in this pull request? This PR makes several updates to SQL programming guide. Author: Yin Huai

spark git commit: [SPARK-16221][SQL] Redirect Parquet JUL logger via SLF4J for WRITE operations

Repository: spark Updated Branches: refs/heads/master 50fdd866b -> a0da854fb [SPARK-16221][SQL] Redirect Parquet JUL logger via SLF4J for WRITE operations ## What changes were proposed in this pull request? [SPARK-8118](https://github.com/apache/spark/pull/8196) implements redirecting

spark git commit: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in API docs

Repository: spark Updated Branches: refs/heads/branch-2.0 4c4f7775c -> 7177e1843 [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in API docs ## What changes were proposed in this pull request? Currently, Spark Scala/Java API documents shows **org.apache.hadoop.hive.ql.io.orc** package

spark git commit: [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in API docs

Repository: spark Updated Branches: refs/heads/master 1b7fc5817 -> 50fdd866b [SPARK-16111][SQL][DOC] Hide SparkOrcNewRecordReader in API docs ## What changes were proposed in this pull request? Currently, Spark Scala/Java API documents shows **org.apache.hadoop.hive.ql.io.orc** package at

spark git commit: [SPARK-16143][R] group AFT survival regression methods docs in a single Rd

Repository: spark Updated Branches: refs/heads/branch-2.0 c7704099d -> 4c4f7775c [SPARK-16143][R] group AFT survival regression methods docs in a single Rd ## What changes were proposed in this pull request? This PR groups `spark.survreg`, `summary(AFT)`, `predict(AFT)`, `write.ml(AFT)` for

spark git commit: [SPARK-13023][PROJECT INFRA][FOLLOWUP][BRANCH-1.6] Unable to check `root` module ending up failure of Python tests

Repository: spark Updated Branches: refs/heads/branch-1.6 22a496d2a -> 4a67541db [SPARK-13023][PROJECT INFRA][FOLLOWUP][BRANCH-1.6] Unable to check `root` module ending up failure of Python tests ## What changes were proposed in this pull request? This PR fixes incorrect checking for `root`

spark git commit: [SPARK-16220][SQL] Add scope to show functions

Repository: spark Updated Branches: refs/heads/branch-2.0 27f3462d0 -> c7704099d [SPARK-16220][SQL] Add scope to show functions ## What changes were proposed in this pull request? Spark currently shows all functions when issue a `SHOW FUNCTIONS` command. This PR refines the `SHOW FUNCTIONS`

spark git commit: [SPARK-16220][SQL] Add scope to show functions

Repository: spark Updated Branches: refs/heads/master c15b552dd -> 02a029df4 [SPARK-16220][SQL] Add scope to show functions ## What changes were proposed in this pull request? Spark currently shows all functions when issue a `SHOW FUNCTIONS` command. This PR refines the `SHOW FUNCTIONS`

svn commit: r1750426 [2/2] - in /spark/site: ./ graphx/ mllib/ news/ releases/ screencasts/ sql/ streaming/

Modified: spark/site/screencasts/3-transformations-and-caching.html URL: http://svn.apache.org/viewvc/spark/site/screencasts/3-transformations-and-caching.html?rev=1750426=1750425=1750426=diff == ---

svn commit: r1750426 [1/2] - in /spark/site: ./ graphx/ mllib/ news/ releases/ screencasts/ sql/ streaming/

Author: rxin Date: Mon Jun 27 23:35:03 2016 New Revision: 1750426 URL: http://svn.apache.org/viewvc?rev=1750426=rev Log: update doc header Modified: spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site/examples.html spark/site/faq.html

svn commit: r1750425 - /spark/_layouts/global.html

Author: rxin Date: Mon Jun 27 23:34:10 2016 New Revision: 1750425 URL: http://svn.apache.org/viewvc?rev=1750425=rev Log: update doc header Modified: spark/_layouts/global.html Modified: spark/_layouts/global.html URL:

svn commit: r1750424 - in /spark: documentation.md site/docs/latest site/documentation.html

Author: rxin Date: Mon Jun 27 23:32:42 2016 New Revision: 1750424 URL: http://svn.apache.org/viewvc?rev=1750424=rev Log: doc update for 1.6.2 Modified: spark/documentation.md spark/site/docs/latest spark/site/documentation.html Modified: spark/documentation.md URL:

svn commit: r1750423 [3/3] - in /spark: ./ js/ news/_posts/ releases/_posts/ site/ site/graphx/ site/js/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Modified: spark/site/releases/spark-release-1-1-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-1-1-0.html?rev=1750423=1750422=1750423=diff == --- spark/site/releases/spark-release-1-1-0.html

svn commit: r1750423 [1/3] - in /spark: ./ js/ news/_posts/ releases/_posts/ site/ site/graphx/ site/js/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Author: rxin Date: Mon Jun 27 23:22:21 2016 New Revision: 1750423 URL: http://svn.apache.org/viewvc?rev=1750423=rev Log: Add 1.6.2 release Added: spark/news/_posts/2016-06-25-spark-1-6-2-released.md spark/releases/_posts/2016-06-25-spark-release-1-6-2.md

svn commit: r1750423 [2/3] - in /spark: ./ js/ news/_posts/ releases/_posts/ site/ site/graphx/ site/js/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Added: spark/site/news/spark-1-6-2-released.html URL: http://svn.apache.org/viewvc/spark/site/news/spark-1-6-2-released.html?rev=1750423=auto == --- spark/site/news/spark-1-6-2-released.html (added) +++

spark git commit: [SPARK-16106][CORE] TaskSchedulerImpl should properly track executors added to existing hosts

Repository: spark Updated Branches: refs/heads/master 282158914 -> c15b552dd [SPARK-16106][CORE] TaskSchedulerImpl should properly track executors added to existing hosts ## What changes were proposed in this pull request? TaskSchedulerImpl used to only set `newExecAvailable` when a new

spark git commit: [SPARK-16136][CORE] Fix flaky TaskManagerSuite

Repository: spark Updated Branches: refs/heads/master 1aa191e58 -> 282158914 [SPARK-16136][CORE] Fix flaky TaskManagerSuite ## What changes were proposed in this pull request? TaskManagerSuite "Kill other task attempts when one attempt belonging to the same task succeeds" was flaky. When

spark git commit: [SPARK-16231][PYSPARK][ML][EXAMPLES] dataframe_example.py fails to convert ML style vectors

Repository: spark Updated Branches: refs/heads/branch-2.0 e4bb31fb3 -> 27f3462d0 [SPARK-16231][PYSPARK][ML][EXAMPLES] dataframe_example.py fails to convert ML style vectors ## What changes were proposed in this pull request? Need to convert ML Vectors to the old MLlib style before doing

svn commit: r1750410 [1/2] - in /spark: ./ _plugins/ mllib/ releases/_posts/ site/ site/mllib/ site/news/ site/releases/ site/sql/ site/streaming/ sql/ streaming/

Author: srowen Date: Mon Jun 27 20:31:41 2016 New Revision: 1750410 URL: http://svn.apache.org/viewvc?rev=1750410=rev Log: Remove Spark site plugins (not used/working); fix jekyll build warning and one bad heading tag; remove inactive {% extra %} tag; commit current output of jekyll for

svn commit: r1750410 [2/2] - in /spark: ./ _plugins/ mllib/ releases/_posts/ site/ site/mllib/ site/news/ site/releases/ site/sql/ site/streaming/ sql/ streaming/

Modified: spark/site/releases/spark-release-1-1-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-1-1-0.html?rev=1750410=1750409=1750410=diff == --- spark/site/releases/spark-release-1-1-0.html

spark git commit: [SPARK-16231][PYSPARK][ML][EXAMPLES] dataframe_example.py fails to convert ML style vectors

Repository: spark Updated Branches: refs/heads/master c17b1abff -> 1aa191e58 [SPARK-16231][PYSPARK][ML][EXAMPLES] dataframe_example.py fails to convert ML style vectors ## What changes were proposed in this pull request? Need to convert ML Vectors to the old MLlib style before doing

spark git commit: [SPARK-16187][ML] Implement util method for ML Matrix conversion in scala/java

Repository: spark Updated Branches: refs/heads/branch-2.0 f2017c59b -> e4bb31fb3 [SPARK-16187][ML] Implement util method for ML Matrix conversion in scala/java ## What changes were proposed in this pull request? jira: https://issues.apache.org/jira/browse/SPARK-16187 This is to provide

spark git commit: [SPARK-16187][ML] Implement util method for ML Matrix conversion in scala/java

Repository: spark Updated Branches: refs/heads/master c48c8ebc0 -> c17b1abff [SPARK-16187][ML] Implement util method for ML Matrix conversion in scala/java ## What changes were proposed in this pull request? jira: https://issues.apache.org/jira/browse/SPARK-16187 This is to provide conversion

spark git commit: [SPARK-16220][SQL] Revert Change to Bring Back SHOW FUNCTIONS Functionality

Repository: spark Updated Branches: refs/heads/branch-2.0 22fe336c8 -> f2017c59b [SPARK-16220][SQL] Revert Change to Bring Back SHOW FUNCTIONS Functionality ## What changes were proposed in this pull request? - Fix tests regarding show functions functionality - Revert `catalog.ListFunctions`

spark git commit: [SPARK-16220][SQL] Revert Change to Bring Back SHOW FUNCTIONS Functionality

Repository: spark Updated Branches: refs/heads/master 3e4e868c8 -> c48c8ebc0 [SPARK-16220][SQL] Revert Change to Bring Back SHOW FUNCTIONS Functionality ## What changes were proposed in this pull request? - Fix tests regarding show functions functionality - Revert `catalog.ListFunctions` and

spark git commit: [SPARK-16135][SQL] Remove hashCode and euqals in ArrayBasedMapData

Repository: spark Updated Branches: refs/heads/branch-2.0 664426e00 -> 22fe336c8 [SPARK-16135][SQL] Remove hashCode and euqals in ArrayBasedMapData ## What changes were proposed in this pull request? This pr is to remove `hashCode` and `equals` in `ArrayBasedMapData` because the type cannot

spark git commit: [SPARK-16135][SQL] Remove hashCode and euqals in ArrayBasedMapData

Repository: spark Updated Branches: refs/heads/master 11f420b4b -> 3e4e868c8 [SPARK-16135][SQL] Remove hashCode and euqals in ArrayBasedMapData ## What changes were proposed in this pull request? This pr is to remove `hashCode` and `equals` in `ArrayBasedMapData` because the type cannot be

spark git commit: [SPARK-10591][SQL][TEST] Add a testcase to ensure if `checkAnswer` handles map correctly

Repository: spark Updated Branches: refs/heads/branch-2.0 ea8d419c1 -> 664426e00 [SPARK-10591][SQL][TEST] Add a testcase to ensure if `checkAnswer` handles map correctly ## What changes were proposed in this pull request? This PR adds a testcase to ensure if `checkAnswer` handles Map type

spark git commit: [SPARK-10591][SQL][TEST] Add a testcase to ensure if `checkAnswer` handles map correctly

Repository: spark Updated Branches: refs/heads/master 52d4fe057 -> 11f420b4b [SPARK-10591][SQL][TEST] Add a testcase to ensure if `checkAnswer` handles map correctly ## What changes were proposed in this pull request? This PR adds a testcase to ensure if `checkAnswer` handles Map type

spark git commit: [MINOR][CORE] Fix display wrong free memory size in the log

Repository: spark Updated Branches: refs/heads/branch-2.0 efce6e17c -> ea8d419c1 [MINOR][CORE] Fix display wrong free memory size in the log ## What changes were proposed in this pull request? Free memory size displayed in the log is wrong (used memory), fix to make it correct. ## How was

spark git commit: [MINOR][CORE] Fix display wrong free memory size in the log

Repository: spark Updated Branches: refs/heads/master b45202632 -> 52d4fe057 [MINOR][CORE] Fix display wrong free memory size in the log ## What changes were proposed in this pull request? Free memory size displayed in the log is wrong (used memory), fix to make it correct. ## How was this

spark git commit: [SPARK-16214][EXAMPLES] fix the denominator of SparkPi

Repository: spark Updated Branches: refs/heads/branch-1.6 60e095b9b -> 22a496d2a [SPARK-16214][EXAMPLES] fix the denominator of SparkPi ## What changes were proposed in this pull request? reduce the denominator of SparkPi by 1 ## How was this patch tested? integration tests Author:

spark git commit: [SPARK-16214][EXAMPLES] fix the denominator of SparkPi

Repository: spark Updated Branches: refs/heads/master 30b182bcc -> b45202632 [SPARK-16214][EXAMPLES] fix the denominator of SparkPi ## What changes were proposed in this pull request? reduce the denominator of SparkPi by 1 ## How was this patch tested? integration tests Author: 杨浩

spark git commit: [SPARK-16214][EXAMPLES] fix the denominator of SparkPi

Repository: spark Updated Branches: refs/heads/branch-2.0 e01776395 -> efce6e17c [SPARK-16214][EXAMPLES] fix the denominator of SparkPi ## What changes were proposed in this pull request? reduce the denominator of SparkPi by 1 ## How was this patch tested? integration tests Author: