spark git commit: [SPARK-20537][CORE] Fixing OffHeapColumnVector reallocation

2017-05-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 b7c1c2f97 -> b146481ff [SPARK-20537][CORE] Fixing OffHeapColumnVector reallocation ## What changes were proposed in this pull request? As #17773 revealed `OnHeapColumnVector` may copy a part of the original storage.

spark git commit: [SPARK-20537][CORE] Fixing OffHeapColumnVector reallocation

2017-05-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 90d77e971 -> afb21bf22 [SPARK-20537][CORE] Fixing OffHeapColumnVector reallocation ## What changes were proposed in this pull request? As #17773 revealed `OnHeapColumnVector` may copy a part of the original storage. `OffHeapColumnVector`

spark git commit: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-05-01 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master d20a976e8 -> 90d77e971 [SPARK-20532][SPARKR] Implement grouping and grouping_id ## What changes were proposed in this pull request? Adds R wrappers for: - `o.a.s.sql.functions.grouping` as `o.a.s.sql.functions.is_grouping` (to avoid

spark git commit: [SPARK-20192][SPARKR][DOC] SparkR migration guide to 2.2.0

2017-05-01 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 5a0a8b039 -> b7c1c2f97 [SPARK-20192][SPARKR][DOC] SparkR migration guide to 2.2.0 ## What changes were proposed in this pull request? Updating R Programming Guide ## How was this patch tested? manually Author: Felix Cheung

spark git commit: [SPARK-20192][SPARKR][DOC] SparkR migration guide to 2.2.0

2017-05-01 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 943a684b9 -> d20a976e8 [SPARK-20192][SPARKR][DOC] SparkR migration guide to 2.2.0 ## What changes were proposed in this pull request? Updating R Programming Guide ## How was this patch tested? manually Author: Felix Cheung

[spark] Git Push Summary

2017-05-01 Thread marmbrus
Repository: spark Updated Tags: refs/tags/v2.1.1-rc3 [deleted] 2ed19cff2 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2017-05-01 Thread marmbrus
Repository: spark Updated Tags: refs/tags/v2.1.1-rc2 [deleted] 02b165dcc - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2017-05-01 Thread marmbrus
Repository: spark Updated Tags: refs/tags/v2.1.1-rc4 [deleted] 267aca5bd - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2017-05-01 Thread marmbrus
Repository: spark Updated Tags: refs/tags/v2.1.1-rc1 [deleted] 30abb95c9 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2017-05-01 Thread marmbrus
Repository: spark Updated Tags: refs/tags/v2.1.1 [created] 267aca5bd - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

svn commit: r19436 - /dev/spark/spark-2.1.1-rc4/

2017-05-01 Thread marmbrus
Author: marmbrus Date: Tue May 2 01:05:29 2017 New Revision: 19436 Log: Add spark-2.1.1-rc4 Added: dev/spark/spark-2.1.1-rc4/ dev/spark/spark-2.1.1-rc4/SparkR_2.1.1.tar.gz (with props) dev/spark/spark-2.1.1-rc4/SparkR_2.1.1.tar.gz.asc

svn commit: r19437 - /dev/spark/spark-2.1.1-rc4/ /release/spark/spark-2.1.1/

2017-05-01 Thread marmbrus
Author: marmbrus Date: Tue May 2 01:06:55 2017 New Revision: 19437 Log: Release Spark 2.1.1 Added: release/spark/spark-2.1.1/ - copied from r19436, dev/spark/spark-2.1.1-rc4/ Removed: dev/spark/spark-2.1.1-rc4/

spark git commit: [SPARK-20548] Disable ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-01 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 259860d23 -> 943a684b9 [SPARK-20548] Disable ReplSuite.newProductSeqEncoder with REPL defined class ## What changes were proposed in this pull request? `newProductSeqEncoder with REPL defined class` in `ReplSuite` has been failing

spark git commit: [SPARK-20463] Add support for IS [NOT] DISTINCT FROM.

2017-05-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master af726cd61 -> 259860d23 [SPARK-20463] Add support for IS [NOT] DISTINCT FROM. ## What changes were proposed in this pull request? Add support for the SQL standard distinct predicate to SPARK SQL. ``` IS [NOT] DISTINCT FROM ``` ## How

spark git commit: [SPARK-20459][SQL] JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

2017-05-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 2b2dd08e9 -> af726cd61 [SPARK-20459][SQL] JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException ## What changes were proposed in this pull request? Avoid failing to initCause on JDBC exception with

spark git commit: [SPARK-20459][SQL] JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

2017-05-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 cfa6bcbe8 -> 5a0a8b039 [SPARK-20459][SQL] JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException ## What changes were proposed in this pull request? Avoid failing to initCause on JDBC exception

spark git commit: [SPARK-20540][CORE] Fix unstable executor requests.

2017-05-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.1 868b4a1aa -> 5915588a9 [SPARK-20540][CORE] Fix unstable executor requests. There are two problems fixed in this commit. First, the ExecutorAllocationManager sets a timeout to avoid requesting executors too often. However, the timeout

spark git commit: [SPARK-20540][CORE] Fix unstable executor requests.

2017-05-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 6f0d29672 -> cfa6bcbe8 [SPARK-20540][CORE] Fix unstable executor requests. There are two problems fixed in this commit. First, the ExecutorAllocationManager sets a timeout to avoid requesting executors too often. However, the timeout

spark git commit: [SPARK-20540][CORE] Fix unstable executor requests.

2017-05-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 6fc6cf88d -> 2b2dd08e9 [SPARK-20540][CORE] Fix unstable executor requests. There are two problems fixed in this commit. First, the ExecutorAllocationManager sets a timeout to avoid requesting executors too often. However, the timeout is

spark git commit: [SPARK-20464][SS] Add a job group and description for streaming queries and fix cancellation of running jobs using the job group

2017-05-01 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 38edb9256 -> 6f0d29672 [SPARK-20464][SS] Add a job group and description for streaming queries and fix cancellation of running jobs using the job group ## What changes were proposed in this pull request? Job group: adding a job group

spark git commit: [SPARK-20464][SS] Add a job group and description for streaming queries and fix cancellation of running jobs using the job group

2017-05-01 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master ab30590f4 -> 6fc6cf88d [SPARK-20464][SS] Add a job group and description for streaming queries and fix cancellation of running jobs using the job group ## What changes were proposed in this pull request? Job group: adding a job group is

spark git commit: [SPARK-20517][UI] Fix broken history UI download link

2017-05-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.1 5131b0a96 -> 868b4a1aa [SPARK-20517][UI] Fix broken history UI download link The download link in history server UI is concatenated with: ``` Download ``` Here `num` field represents number of attempts, this is not equal to REST

spark git commit: [SPARK-20517][UI] Fix broken history UI download link

2017-05-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 813abd2db -> 38edb9256 [SPARK-20517][UI] Fix broken history UI download link The download link in history server UI is concatenated with: ``` Download ``` Here `num` field represents number of attempts, this is not equal to REST

spark git commit: [SPARK-20517][UI] Fix broken history UI download link

2017-05-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 6b44c4d63 -> ab30590f4 [SPARK-20517][UI] Fix broken history UI download link The download link in history server UI is concatenated with: ``` Download ``` Here `num` field represents number of attempts, this is not equal to REST APIs.

spark git commit: [SPARK-20534][SQL] Make outer generate exec return empty rows

2017-05-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 c890e938c -> 813abd2db [SPARK-20534][SQL] Make outer generate exec return empty rows ## What changes were proposed in this pull request? Generate exec does not produce `null` values if the generator for the input row is empty and the

spark git commit: [SPARK-20534][SQL] Make outer generate exec return empty rows

2017-05-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master f0169a1c6 -> 6b44c4d63 [SPARK-20534][SQL] Make outer generate exec return empty rows ## What changes were proposed in this pull request? Generate exec does not produce `null` values if the generator for the input row is empty and the

spark git commit: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper for eqNullSafe

2017-05-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master a355b667a -> f0169a1c6 [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper for eqNullSafe ## What changes were proposed in this pull request? Adds Python bindings for `Column.eqNullSafe` ## How was this patch tested? Manual tests,

spark git commit: [SPARK-20541][SPARKR][SS] support awaitTermination without timeout

2017-05-01 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 994d9da90 -> c890e938c [SPARK-20541][SPARKR][SS] support awaitTermination without timeout ## What changes were proposed in this pull request? Add without param for timeout - will need this to submit a job that runs until stopped Need

spark git commit: [SPARK-20541][SPARKR][SS] support awaitTermination without timeout

2017-05-01 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 80e9cf1b5 -> a355b667a [SPARK-20541][SPARKR][SS] support awaitTermination without timeout ## What changes were proposed in this pull request? Add without param for timeout - will need this to submit a job that runs until stopped Need