spark git commit: [SPARK-17647][SQL] Fix backslash escaping in 'LIKE' patterns.

2017-04-17 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 7aad057b0 -> db9517c16 [SPARK-17647][SQL] Fix backslash escaping in 'LIKE' patterns. This patch fixes a bug in the way LIKE patterns are translated to Java regexes. The bug causes any character following an escaped backslash to be

spark git commit: [SPARK-17647][SQL] Fix backslash escaping in 'LIKE' patterns.

2017-04-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 01ff0350a -> e5fee3e4f [SPARK-17647][SQL] Fix backslash escaping in 'LIKE' patterns. ## What changes were proposed in this pull request? This patch fixes a bug in the way LIKE patterns are translated to Java regexes. The bug causes any

spark git commit: [SPARK-20302][SQL] Short circuit cast when from and to types are structurally the same

2017-04-12 Thread rxin
lly the same (having the same structure but different field names), we should be able to skip the actual cast. ## How was this patch tested? Added unit tests for the newly introduced functions. Author: Reynold Xin <r...@databricks.com> Closes #17614 from rxin/SPARK-20302. Project: http:

spark git commit: [SPARK-20289][SQL] Use StaticInvoke to box primitive types

2017-04-11 Thread rxin
tor). Instead, it'd be slightly more idiomatic in Java to use PrimitiveType.valueOf, which can be invoked using StaticInvoke expression. ## How was this patch tested? The change should be covered by existing tests for Dataset encoders. Author: Reynold Xin <r...@databricks.com> Closes #17604

spark git commit: [SPARK-17564][TESTS] Fix flaky RequestTimeoutIntegrationSuite.furtherRequestsDelay

2017-04-10 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 f40e44de8 -> 8eb71b81f [SPARK-17564][TESTS] Fix flaky RequestTimeoutIntegrationSuite.furtherRequestsDelay ## What changes were proposed in this pull request? This PR fixs the following failure: ``` sbt.ForkMain$ForkError:

spark git commit: [SPARK-17564][TESTS] Fix flaky RequestTimeoutIntegrationSuite.furtherRequestsDelay

2017-04-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 379b0b0bb -> 734dfbfcf [SPARK-17564][TESTS] Fix flaky RequestTimeoutIntegrationSuite.furtherRequestsDelay ## What changes were proposed in this pull request? This PR fixs the following failure: ``` sbt.ForkMain$ForkError:

spark git commit: [SPARK-20283][SQL] Add preOptimizationBatches

2017-04-10 Thread rxin
hes so the optimizer debugging extensions are symmetric. ## How was this patch tested? N/A Author: Reynold Xin <r...@databricks.com> Closes #17595 from rxin/SPARK-20283. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit

spark git commit: [SPARK-20255] Move listLeafFiles() to InMemoryFileIndex

2017-04-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1ad73f0a2 -> 589f3edb8 [SPARK-20255] Move listLeafFiles() to InMemoryFileIndex ## What changes were proposed in this pull request Trying to get a grip on the `FileIndex` hierarchy, I was confused by the following inconsistency: On the

spark git commit: [MINOR][DOCS] Fix typo in Hive Examples

2017-04-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master a4491626e -> 8129d59d0 [MINOR][DOCS] Fix typo in Hive Examples ## What changes were proposed in this pull request? Fix typo in hive examples from "DaraFrames" to "DataFrames" ## How was this patch tested? N/A Please review

spark git commit: Small doc fix for ReuseSubquery.

2017-04-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master c1b8b6675 -> b6e71032d Small doc fix for ReuseSubquery. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b6e71032 Tree:

[2/2] spark git commit: [SPARK-20204][SQL] remove SimpleCatalystConf and CatalystConf type alias

2017-04-04 Thread rxin
[SPARK-20204][SQL] remove SimpleCatalystConf and CatalystConf type alias ## What changes were proposed in this pull request? This is a follow-up of https://github.com/apache/spark/pull/17285 . ## How was this patch tested? existing tests Author: Wenchen Fan Closes

[1/2] spark git commit: [SPARK-20204][SQL] remove SimpleCatalystConf and CatalystConf type alias

2017-04-04 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0e2ee8204 -> 402bf2a50 http://git-wip-us.apache.org/repos/asf/spark/blob/402bf2a5/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/plans/PlanTest.scala -- diff

spark git commit: [SPARK-18278][SCHEDULER] Documentation to point to Kubernetes cluster scheduler

2017-04-04 Thread rxin
out-of-repo in https://github.com/apache-spark-on-k8s/spark cc rxin srowen tnachen ash211 mccheah erikerlandson ## How was this patch tested? Docs only change Author: Anirudh Ramanathan <fox...@users.noreply.github.com> Author: foxish <ramanath...@google.com> Closes #17522 from foxi

spark git commit: [SPARK-20145] Fix range case insensitive bug in SQL

2017-04-03 Thread rxin
Repository: spark Updated Branches: refs/heads/master 703c42c39 -> 58c9e6e77 [SPARK-20145] Fix range case insensitive bug in SQL ## What changes were proposed in this pull request? Range in SQL should be case insensitive ## How was this patch tested? unit test Author: samelamin

spark git commit: [SPARK-20151][SQL] Account for partition pruning in scan metadataTime metrics

2017-03-31 Thread rxin
I'm not sure if this is worth it. Author: Reynold Xin <r...@databricks.com> Closes #17476 from rxin/SPARK-20151. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a8a765b3 Tree: http://git-wip-us.apache.org/repos/asf/s

spark git commit: [SPARK-20148][SQL] Extend the file commit API to allow subscribing to task commit messages

2017-03-29 Thread rxin
tch tested? Unit tests. cc rxin Author: Eric Liang <e...@databricks.com> Closes #17475 from ericl/file-commit-api-ext. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/79636054 Tree: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-20136][SQL] Add num files and metadata operation timing to scan operator metrics

2017-03-29 Thread rxin
tested? N/A Author: Reynold Xin <r...@databricks.com> Closes #17465 from rxin/SPARK-20136. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/60977889 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/60977889 Diff: ht

spark git commit: [SPARK-20146][SQL] fix comment missing issue for thrift server

2017-03-29 Thread rxin
Repository: spark Updated Branches: refs/heads/master dd2e7d528 -> 22f07fefe [SPARK-20146][SQL] fix comment missing issue for thrift server ## What changes were proposed in this pull request? The column comment was missing while constructing the Hive TableSchema. This fix will preserve the

spark git commit: [SPARK-20134][SQL] SQLMetrics.postDriverMetricUpdates to simplify driver side metric updates

2017-03-29 Thread rxin
ide. This patch introduces a new SQLMetrics.postDriverMetricUpdates function to do that, and adds documentation to make it more obvious. ## How was this patch tested? Updated a test case to use this method. Author: Reynold Xin <r...@databricks.com> Closes #17464 from rxin/SPARK-20134.

spark git commit: [SPARK-20134][SQL] SQLMetrics.postDriverMetricUpdates to simplify driver side metric updates

2017-03-29 Thread rxin
ver side. This patch introduces a new SQLMetrics.postDriverMetricUpdates function to do that, and adds documentation to make it more obvious. ## How was this patch tested? Updated a test case to use this method. Author: Reynold Xin <r...@databricks.com> Closes #17464 from rxin/SPARK-20134.

spark git commit: [SPARK-20070][SQL] Fix 2.10 build

2017-03-24 Thread rxin
Repository: spark Updated Branches: refs/heads/master f88f56b83 -> 0a6c50711 [SPARK-20070][SQL] Fix 2.10 build ## What changes were proposed in this pull request? Commit https://github.com/apache/spark/commit/91fa80fe8a2480d64c430bd10f97b3d44c007bcc broke the build for scala 2.10. The

spark git commit: [DOCS] Clarify round mode for format_number & round functions

2017-03-24 Thread rxin
Repository: spark Updated Branches: refs/heads/master e011004be -> f88f56b83 [DOCS] Clarify round mode for format_number & round functions ## What changes were proposed in this pull request? Updated the description for the `format_number` description to indicate that it uses `HALF_EVEN`

spark git commit: [SPARK-19846][SQL] Add a flag to disable constraint propagation

2017-03-24 Thread rxin
Repository: spark Updated Branches: refs/heads/master b5c5bd98e -> e011004be [SPARK-19846][SQL] Add a flag to disable constraint propagation ## What changes were proposed in this pull request? Constraint propagation can be computation expensive and block the driver execution for long time.

spark git commit: Disable generate codegen since it fails my workload.

2017-03-24 Thread rxin
Repository: spark Updated Branches: refs/heads/master 91fa80fe8 -> b5c5bd98e Disable generate codegen since it fails my workload. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b5c5bd98 Tree:

spark git commit: Typo fixup in comment

2017-03-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master b70c03a42 -> b0ae6a38a Typo fixup in comment ## What changes were proposed in this pull request? Fixup typo in comment. ## How was this patch tested? Don't need. Author: Ye Yin Closes #17396 from hustcat/fix. Project:

spark git commit: clarify array_contains function description

2017-03-21 Thread rxin
Repository: spark Updated Branches: refs/heads/master a8877bdbb -> a04dcde8c clarify array_contains function description ## What changes were proposed in this pull request? The description in the comment for array_contains is vague/incomplete (i.e., doesn't mention that it returns `null` if

spark git commit: clarify array_contains function description

2017-03-21 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 5c18b6c31 -> 9dfdd2adf clarify array_contains function description ## What changes were proposed in this pull request? The description in the comment for array_contains is vague/incomplete (i.e., doesn't mention that it returns

spark git commit: [SQL][MINOR] Fix scaladoc for UDFRegistration

2017-03-17 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 5fb70831b -> 780f6060c [SQL][MINOR] Fix scaladoc for UDFRegistration ## What changes were proposed in this pull request? Fix scaladoc for UDFRegistration ## How was this patch tested? local build Author: Jacek Laskowski

spark git commit: [SQL][MINOR] Fix scaladoc for UDFRegistration

2017-03-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3783539d7 -> 6326d406b [SQL][MINOR] Fix scaladoc for UDFRegistration ## What changes were proposed in this pull request? Fix scaladoc for UDFRegistration ## How was this patch tested? local build Author: Jacek Laskowski

spark git commit: [SPARK-18847][GRAPHX] PageRank gives incorrect results for graphs with sinks

2017-03-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 376d78216 -> bfdeea5c6 [SPARK-18847][GRAPHX] PageRank gives incorrect results for graphs with sinks ## What changes were proposed in this pull request? Graphs with sinks (vertices with no outgoing edges) don't have the expected rank sum

spark git commit: [MINOR][CORE] Fix a info message of `prunePartitions`

2017-03-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master 97cc5e5a5 -> 54a3697f1 [MINOR][CORE] Fix a info message of `prunePartitions` ## What changes were proposed in this pull request? `PrunedInMemoryFileIndex.prunePartitions` shows `pruned NaN% partitions` for the following case. ```scala

spark git commit: [SPARK-19960][CORE] Move `SparkHadoopWriter` to `internal/io/`

2017-03-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master 02c274eab -> 97cc5e5a5 [SPARK-19960][CORE] Move `SparkHadoopWriter` to `internal/io/` ## What changes were proposed in this pull request? This PR introduces the following changes: 1. Move `SparkHadoopWriter` to `core/internal/io/`, so

spark git commit: [SPARK-19843][SQL][FOLLOWUP] Classdoc for `IntWrapper` and `LongWrapper`

2017-03-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9a6ac7226 -> e420fd459 [SPARK-19843][SQL][FOLLOWUP] Classdoc for `IntWrapper` and `LongWrapper` ## What changes were proposed in this pull request? This is as per suggestion by rxin at : https://github.com/apache/spark/pull/17

spark git commit: [SPARK-17495][SQL] Add more tests for hive hash

2017-02-24 Thread rxin
Repository: spark Updated Branches: refs/heads/master a920a4369 -> 3e40f6c3d [SPARK-17495][SQL] Add more tests for hive hash ## What changes were proposed in this pull request? This PR adds tests hive-hash by comparing the outputs generated against Hive 1.2.1. Following datatypes are

spark git commit: [SPARK-19447] Make Range operator generate "recordsRead" metric

2017-02-18 Thread rxin
Repository: spark Updated Branches: refs/heads/master 729ce3703 -> b486ffc86 [SPARK-19447] Make Range operator generate "recordsRead" metric ## What changes were proposed in this pull request? The Range was modified to produce "recordsRead" metric instead of "generated rows". The tests were

spark git commit: [SPARK-19607][HOTFIX] Finding QueryExecution that matches provided executionId

2017-02-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3755da76c -> 59dc26e37 [SPARK-19607][HOTFIX] Finding QueryExecution that matches provided executionId ## What changes were proposed in this pull request? #16940 adds a test case which does not stop the spark job. It causes many failures

spark git commit: [SPARK-16475][SQL] broadcast hint for SQL queries - disallow space as the delimiter

2017-02-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master a8a139820 -> acf71c63c [SPARK-16475][SQL] broadcast hint for SQL queries - disallow space as the delimiter ## What changes were proposed in this pull request? A follow-up to disallow space as the delimiter in broadcast hint. ## How was

spark git commit: [SPARK-19607] Finding QueryExecution that matches provided executionId

2017-02-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3973403d5 -> b55563c17 [SPARK-19607] Finding QueryExecution that matches provided executionId ## What changes were proposed in this pull request? Implementing a mapping between executionId and corresponding QueryExecution in

spark git commit: [SPARK-19514] Enhancing the test for Range interruption.

2017-02-13 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1c4d10b10 -> 0417ce878 [SPARK-19514] Enhancing the test for Range interruption. Improve the test for SPARK-19514, so that it's clear which stage is being cancelled. Author: Ala Luszczak Closes #16914 from

spark git commit: [SPARK-19549] Allow providing reason for stage/job cancelling

2017-02-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3a43ae7c0 -> d785217b7 [SPARK-19549] Allow providing reason for stage/job cancelling ## What changes were proposed in this pull request? This change add an optional argument to `SparkContext.cancelStage()` and `SparkContext.cancelJob()`

spark git commit: Encryption of shuffle files

2017-02-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 8640dc082 -> c5a66356d Encryption of shuffle files Hello According to my understanding of commits 4b4e329e49f8af28fa6301bd06c48d7097eaf9e6 & 8b325b17ecdf013b7a6edcb7ee3773546bd914df, one may now encrypt shuffle files regardless of the

spark git commit: [SPARK-19512][BACKPORT-2.1][SQL] codegen for compare structs fails #16852

2017-02-10 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 a3d5300a0 -> ff5818b8c [SPARK-19512][BACKPORT-2.1][SQL] codegen for compare structs fails #16852 ## What changes were proposed in this pull request? Set currentVars to null in GenerateOrdering.genComparisons before genCode is called.

spark git commit: [SPARK-19514] Making range interruptible.

2017-02-09 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3fc8e8caf -> 4064574d0 [SPARK-19514] Making range interruptible. ## What changes were proposed in this pull request? Previously range operator could not be interrupted. For example, using DAGScheduler.cancelStage(...) on a query with

spark git commit: [SPARK-19495][SQL] Make SQLConf slightly more extensible

2017-02-07 Thread rxin
ons on the build* functions. ## How was this patch tested? N/A - there are no logic changes and everything should be covered by existing unit tests. Author: Reynold Xin <r...@databricks.com> Closes #16835 from rxin/SPARK-19495. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: h

spark git commit: [SPARK-19447] Fixing input metrics for range operator.

2017-02-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master e99e34d0f -> 6ed285c68 [SPARK-19447] Fixing input metrics for range operator. ## What changes were proposed in this pull request? This change introduces a new metric "number of generated rows". It is used exclusively for Range, which is

spark git commit: [SPARK-19411][SQL] Remove the metadata used to mark optional columns in merged Parquet schema for filter predicate pushdown

2017-02-03 Thread rxin
Repository: spark Updated Branches: refs/heads/master c86a57f4d -> bf493686e [SPARK-19411][SQL] Remove the metadata used to mark optional columns in merged Parquet schema for filter predicate pushdown ## What changes were proposed in this pull request? There is a metadata introduced before

spark git commit: [SPARK-19409][BUILD] Bump parquet version to 1.8.2

2017-01-31 Thread rxin
Repository: spark Updated Branches: refs/heads/master be7425e26 -> 26a4cba3f [SPARK-19409][BUILD] Bump parquet version to 1.8.2 ## What changes were proposed in this pull request? According to the discussion on #16281 which tried to upgrade toward Apache Parquet 1.9.0, Apache Spark

spark git commit: [SPARK-19403][PYTHON][SQL] Correct pyspark.sql.column.__all__ list.

2017-01-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master ade075aed -> 06fbc3554 [SPARK-19403][PYTHON][SQL] Correct pyspark.sql.column.__all__ list. ## What changes were proposed in this pull request? This removes from the `__all__` list class names that are not defined (visible) in the

spark git commit: [SPARK-18495][UI] Document meaning of green dot in DAG visualization

2017-01-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master 47d5d0ddb -> 233845126 [SPARK-18495][UI] Document meaning of green dot in DAG visualization ## What changes were proposed in this pull request? A green dot in the DAG visualization apparently means that the referenced RDD is cached. This

spark git commit: [SPARK-18917][SQL] Remove schema check in appending data

2017-01-17 Thread rxin
tch tested? N/A Closes #16339. Author: Reynold Xin <r...@databricks.com> Closes #16622 from rxin/SPARK-18917. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/83dff87d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree

spark git commit: [MINOR][SQL] Remove duplicate call of reset() function in CurrentOrigin.withOrigin()

2017-01-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 843ec8ec4 -> fee20df14 [MINOR][SQL] Remove duplicate call of reset() function in CurrentOrigin.withOrigin() ## What changes were proposed in this pull request? Remove duplicate call of reset() function in CurrentOrigin.withOrigin(). ##

spark git commit: Fix missing close-parens for In filter's toString

2017-01-12 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6b34e745b -> b040cef2e Fix missing close-parens for In filter's toString Otherwise the open parentheses isn't closed in query plan descriptions of batch scans. PushedFilters: [In(COL_A, [1,2,4,6,10,16,219,815], IsNotNull(COL_B), ...

spark git commit: Fix missing close-parens for In filter's toString

2017-01-12 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 55d2a1178 -> be527ddc0 Fix missing close-parens for In filter's toString Otherwise the open parentheses isn't closed in query plan descriptions of batch scans. PushedFilters: [In(COL_A, [1,2,4,6,10,16,219,815], IsNotNull(COL_B),

spark git commit: Fix missing close-parens for In filter's toString

2017-01-12 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 23944d0d6 -> 0668e061b Fix missing close-parens for In filter's toString Otherwise the open parentheses isn't closed in query plan descriptions of batch scans. PushedFilters: [In(COL_A, [1,2,4,6,10,16,219,815], IsNotNull(COL_B),

spark git commit: [SPARK-19164][PYTHON][SQL] Remove unused UserDefinedFunction._broadcast

2017-01-12 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2c586f506 -> 5db35b312 [SPARK-19164][PYTHON][SQL] Remove unused UserDefinedFunction._broadcast ## What changes were proposed in this pull request? Removes `UserDefinedFunction._broadcast` and `UserDefinedFunction.__del__` method. ## How

spark git commit: [SPARK-19132][SQL] Add test cases for row size estimation and aggregate estimation

2017-01-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master 66fe819ad -> 43fa21b3e [SPARK-19132][SQL] Add test cases for row size estimation and aggregate estimation ## What changes were proposed in this pull request? In this pr, we add more test cases for project and aggregate estimation. ##

spark git commit: [SPARK-19149][SQL] Follow-up: simplify cache implementation.

2017-01-11 Thread rxin
tps://github.com/apache/spark/pull/16529 ## How was this patch tested? N/A - this has no behavior change. Author: Reynold Xin <r...@databricks.com> Closes #16544 from rxin/SPARK-19149. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-19149][SQL] Unify two sets of statistics in LogicalPlan

2017-01-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3b19c74e7 -> a61551356 [SPARK-19149][SQL] Unify two sets of statistics in LogicalPlan ## What changes were proposed in this pull request? Currently we have two sets of statistics in LogicalPlan: a simple stats and a stats estimated by

spark git commit: [SPARK-19020][SQL] Cardinality estimation of aggregate operator

2017-01-09 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3ccabdfb4 -> 15c2bd01b [SPARK-19020][SQL] Cardinality estimation of aggregate operator ## What changes were proposed in this pull request? Support cardinality estimation of aggregate operator ## How was this patch tested? Add test cases

spark git commit: [SPARK-17077][SQL] Cardinality estimation for project operator

2017-01-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 19d9d4c85 -> 3ccabdfb4 [SPARK-17077][SQL] Cardinality estimation for project operator ## What changes were proposed in this pull request? Support cardinality estimation for project operator. ## How was this patch tested? Add a test

spark git commit: [SPARK-19127][DOCS] Update Rank Function Documentation

2017-01-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 ecc16220d -> 8690d4bd1 [SPARK-19127][DOCS] Update Rank Function Documentation ## What changes were proposed in this pull request? - [X] Fix inconsistencies in function reference for dense rank and dense - [X] Make all languages

spark git commit: [SPARK-19127][DOCS] Update Rank Function Documentation

2017-01-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4351e6220 -> 1f6ded645 [SPARK-19127][DOCS] Update Rank Function Documentation ## What changes were proposed in this pull request? - [X] Fix inconsistencies in function reference for dense rank and dense - [X] Make all languages equivalent

[14/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/index.html -- diff --git a/site/docs/2.1.0/api/java/index.html b/site/docs/2.1.0/api/java/index.html new file mode 100644 index

[43/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/crossJoin.html -- diff --git a/site/docs/2.1.0/api/R/crossJoin.html b/site/docs/2.1.0/api/R/crossJoin.html new file mode 100644 index

[15/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/index-all.html -- diff --git a/site/docs/2.1.0/api/java/index-all.html b/site/docs/2.1.0/api/java/index-all.html new file mode 100644

[47/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/approxCountDistinct.html -- diff --git a/site/docs/2.1.0/api/R/approxCountDistinct.html b/site/docs/2.1.0/api/R/approxCountDistinct.html new

[01/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site a82adf043 -> 066dfa274 http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkJobInfo.html -- diff

[05/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/RangePartitioner.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/RangePartitioner.html

[31/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/randomSplit.html -- diff --git a/site/docs/2.1.0/api/R/randomSplit.html b/site/docs/2.1.0/api/R/randomSplit.html new file mode 100644 index

[25/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/sparkR.callJStatic.html -- diff --git a/site/docs/2.1.0/api/R/sparkR.callJStatic.html b/site/docs/2.1.0/api/R/sparkR.callJStatic.html new

[16/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/constant-values.html -- diff --git a/site/docs/2.1.0/api/java/constant-values.html b/site/docs/2.1.0/api/java/constant-values.html new

[39/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/floor.html -- diff --git a/site/docs/2.1.0/api/R/floor.html b/site/docs/2.1.0/api/R/floor.html new file mode 100644 index 000..2dfc290

[04/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkConf.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/SparkConf.html

[38/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/greatest.html -- diff --git a/site/docs/2.1.0/api/R/greatest.html b/site/docs/2.1.0/api/R/greatest.html new file mode 100644 index

[20/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/write.df.html -- diff --git a/site/docs/2.1.0/api/R/write.df.html b/site/docs/2.1.0/api/R/write.df.html new file mode 100644 index

[06/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/JobExecutionStatus.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/JobExecutionStatus.html

[02/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkEnv.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/SparkEnv.html

[35/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/locate.html -- diff --git a/site/docs/2.1.0/api/R/locate.html b/site/docs/2.1.0/api/R/locate.html new file mode 100644 index

[44/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/conv.html -- diff --git a/site/docs/2.1.0/api/R/conv.html b/site/docs/2.1.0/api/R/conv.html new file mode 100644 index 000..b7f1a82 ---

[49/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/00Index.html -- diff --git a/site/docs/2.1.0/api/R/00Index.html b/site/docs/2.1.0/api/R/00Index.html new file mode 100644 index

[10/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/CleanAccum.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/CleanAccum.html

[34/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/merge.html -- diff --git a/site/docs/2.1.0/api/R/merge.html b/site/docs/2.1.0/api/R/merge.html new file mode 100644 index 000..9ebbee4

[40/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/explain.html -- diff --git a/site/docs/2.1.0/api/R/explain.html b/site/docs/2.1.0/api/R/explain.html new file mode 100644 index

[07/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/InternalAccumulator.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/InternalAccumulator.html

[13/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/lib/jquery.js -- diff --git a/site/docs/2.1.0/api/java/lib/jquery.js b/site/docs/2.1.0/api/java/lib/jquery.js new file mode 100644 index

[19/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/write.parquet.html -- diff --git a/site/docs/2.1.0/api/R/write.parquet.html b/site/docs/2.1.0/api/R/write.parquet.html new file mode 100644

[37/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/ifelse.html -- diff --git a/site/docs/2.1.0/api/R/ifelse.html b/site/docs/2.1.0/api/R/ifelse.html new file mode 100644 index

[17/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/allclasses-noframe.html -- diff --git a/site/docs/2.1.0/api/java/allclasses-noframe.html

[21/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/var_pop.html -- diff --git a/site/docs/2.1.0/api/R/var_pop.html b/site/docs/2.1.0/api/R/var_pop.html new file mode 100644 index

[23/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/summary.html -- diff --git a/site/docs/2.1.0/api/R/summary.html b/site/docs/2.1.0/api/R/summary.html new file mode 100644 index

[42/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/datediff.html -- diff --git a/site/docs/2.1.0/api/R/datediff.html b/site/docs/2.1.0/api/R/datediff.html new file mode 100644 index

[48/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/00frame_toc.html -- diff --git a/site/docs/2.1.0/api/R/00frame_toc.html b/site/docs/2.1.0/api/R/00frame_toc.html new file mode 100644 index

[11/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git

[41/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/dropDuplicates.html -- diff --git a/site/docs/2.1.0/api/R/dropDuplicates.html b/site/docs/2.1.0/api/R/dropDuplicates.html new file mode

[24/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/struct.html -- diff --git a/site/docs/2.1.0/api/R/struct.html b/site/docs/2.1.0/api/R/struct.html new file mode 100644 index

[18/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/allclasses-frame.html -- diff --git a/site/docs/2.1.0/api/java/allclasses-frame.html b/site/docs/2.1.0/api/java/allclasses-frame.html new

[22/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/translate.html -- diff --git a/site/docs/2.1.0/api/R/translate.html b/site/docs/2.1.0/api/R/translate.html new file mode 100644 index

[50/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/README.md -- diff --git a/site/docs/2.1.0/README.md b/site/docs/2.1.0/README.md new file mode 100644 index 000..ffd3b57 --- /dev/null +++

[45/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/ceil.html -- diff --git a/site/docs/2.1.0/api/R/ceil.html b/site/docs/2.1.0/api/R/ceil.html new file mode 100644 index 000..7c1c73c ---

[30/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/registerTempTable-deprecated.html -- diff --git a/site/docs/2.1.0/api/R/registerTempTable-deprecated.html

<    1   2   3   4   5   6   7   8   9   10   >