spark git commit: [SPARK-15985][SQL] Eliminate redundant cast from an array without null or a map without null

Repository: spark Updated Branches: refs/heads/master 231f97329 -> d92cd227c [SPARK-15985][SQL] Eliminate redundant cast from an array without null or a map without null ## What changes were proposed in this pull request? This PR eliminates redundant cast from an `ArrayType` with

spark git commit: [SPARK-17318][TESTS] Fix ReplSuite replicating blocks of object with class defined in repl

Repository: spark Updated Branches: refs/heads/master f7beae6da -> 231f97329 [SPARK-17318][TESTS] Fix ReplSuite replicating blocks of object with class defined in repl ## What changes were proposed in this pull request? There are a lot of failures recently:

spark git commit: [SPARK-17243][WEB UI] Spark 2.0 History Server won't load with very large application history

Repository: spark Updated Branches: refs/heads/master 02ac379e8 -> f7beae6da [SPARK-17243][WEB UI] Spark 2.0 History Server won't load with very large application history ## What changes were proposed in this pull request? With the new History Server the summary page loads the application

spark git commit: [SPARK-17314][CORE] Use Netty's DefaultThreadFactory to enable its fast ThreadLocal impl

Repository: spark Updated Branches: refs/heads/master fb2008431 -> 02ac379e8 [SPARK-17314][CORE] Use Netty's DefaultThreadFactory to enable its fast ThreadLocal impl ## What changes were proposed in this pull request? When a thread is a Netty's FastThreadLocalThread, Netty will use its fast

spark git commit: [SPARK-17304] Fix perf. issue caused by TaskSetManager.abortIfCompletelyBlacklisted

Repository: spark Updated Branches: refs/heads/master 4b4e329e4 -> fb2008431 [SPARK-17304] Fix perf. issue caused by TaskSetManager.abortIfCompletelyBlacklisted This patch addresses a minor scheduler performance issue that was introduced in #13603. If you run ``` sc.parallelize(1 to

spark git commit: [SPARK-5682][CORE] Add encrypted shuffle in spark

Repository: spark Updated Branches: refs/heads/master 27209252f -> 4b4e329e4 [SPARK-5682][CORE] Add encrypted shuffle in spark This patch is using Apache Commons Crypto library to enable shuffle encryption support. Author: Ferdinand Xu Author: kellyzly

spark git commit: [MINOR][MLLIB][SQL] Clean up unused variables and unused import

Repository: spark Updated Branches: refs/heads/master d4eee9932 -> 27209252f [MINOR][MLLIB][SQL] Clean up unused variables and unused import ## What changes were proposed in this pull request? Clean up unused variables and unused import statements, unnecessary `return` and `toArray`, and

spark git commit: [MINOR][DOCS] Fix minor typos in python example code

Repository: spark Updated Branches: refs/heads/master befab9c1c -> d4eee9932 [MINOR][DOCS] Fix minor typos in python example code ## What changes were proposed in this pull request? Fix minor typos python example code in streaming programming guide ## How was this patch tested? N/A

spark git commit: [SPARK-17264][SQL] DataStreamWriter should document that it only supports Parquet for now

Repository: spark Updated Branches: refs/heads/branch-2.0 59032570f -> f35b10ab1 [SPARK-17264][SQL] DataStreamWriter should document that it only supports Parquet for now ## What changes were proposed in this pull request? Clarify that only parquet files are supported by DataStreamWriter

spark git commit: [SPARK-17276][CORE][TEST] Stop env params output on Jenkins job page

Repository: spark Updated Branches: refs/heads/master bca79c823 -> 2d76cb11f [SPARK-17276][CORE][TEST] Stop env params output on Jenkins job page https://issues.apache.org/jira/browse/SPARK-17276 ## What changes were proposed in this pull request? When trying to find error msg in a failed

spark git commit: [SPARK-17234][SQL] Table Existence Checking when Index Table with the Same Name Exists

Repository: spark Updated Branches: refs/heads/master 94922d79e -> bca79c823 [SPARK-17234][SQL] Table Existence Checking when Index Table with the Same Name Exists ### What changes were proposed in this pull request? Hive Index tables are not supported by Spark SQL. Thus, we issue an

spark git commit: [SPARK-17289][SQL] Fix a bug to satisfy sort requirements in partial aggregations

Repository: spark Updated Branches: refs/heads/master 8fb445d9b -> 94922d79e [SPARK-17289][SQL] Fix a bug to satisfy sort requirements in partial aggregations ## What changes were proposed in this pull request? Partial aggregations are generated in `EnsureRequirements`, but the planner

spark git commit: [SPARK-17303] Added spark-warehouse to dev/.rat-excludes

Repository: spark Updated Branches: refs/heads/master 48b459ddd -> 8fb445d9b [SPARK-17303] Added spark-warehouse to dev/.rat-excludes ## What changes were proposed in this pull request? Excludes the `spark-warehouse` directory from the Apache RAT checks that src/run-tests performs.