spark git commit: [SPARK-17499][SPARKR][FOLLOWUP] Check null first for layers in spark.mlp to avoid warnings in test results

Repository: spark Updated Branches: refs/heads/master b03b4adf6 -> 4a8339568 [SPARK-17499][SPARKR][FOLLOWUP] Check null first for layers in spark.mlp to avoid warnings in test results ## What changes were proposed in this pull request? Some tests in `test_mllib.r` are as below: ```r

spark git commit: [SPARK-17666] Ensure that RecordReaders are closed by data source file scans

Repository: spark Updated Branches: refs/heads/master e7bce9e18 -> b03b4adf6 [SPARK-17666] Ensure that RecordReaders are closed by data source file scans ## What changes were proposed in this pull request? This patch addresses a potential cause of resource leaks in data source file scans.

spark git commit: [SPARK-17056][CORE] Fix a wrong assert regarding unroll memory in MemoryStore

Repository: spark Updated Branches: refs/heads/branch-2.0 98bbc4410 -> 2cd327ef5 [SPARK-17056][CORE] Fix a wrong assert regarding unroll memory in MemoryStore ## What changes were proposed in this pull request? There is an assert in MemoryStore's putIteratorAsValues method which is used to

spark git commit: [SPARK-17056][CORE] Fix a wrong assert regarding unroll memory in MemoryStore

Repository: spark Updated Branches: refs/heads/master 2f84a6866 -> e7bce9e18 [SPARK-17056][CORE] Fix a wrong assert regarding unroll memory in MemoryStore ## What changes were proposed in this pull request? There is an assert in MemoryStore's putIteratorAsValues method which is used to

spark git commit: [SPARK-17618] Guard against invalid comparisons between UnsafeRow and other formats

Repository: spark Updated Branches: refs/heads/branch-2.0 f4594900d -> 98bbc4410 [SPARK-17618] Guard against invalid comparisons between UnsafeRow and other formats This patch ports changes from #15185 to Spark 2.x. In that patch, a correctness bug in Spark 1.6.x which was caused by an

spark git commit: [SPARK-17618] Guard against invalid comparisons between UnsafeRow and other formats

Repository: spark Updated Branches: refs/heads/master 67c73052b -> 2f84a6866 [SPARK-17618] Guard against invalid comparisons between UnsafeRow and other formats This patch ports changes from #15185 to Spark 2.x. In that patch, a correctness bug in Spark 1.6.x which was caused by an invalid

[2/2] spark git commit: [SPARK-17677][SQL] Break WindowExec.scala into multiple files

[SPARK-17677][SQL] Break WindowExec.scala into multiple files ## What changes were proposed in this pull request? As of Spark 2.0, all the window function execution code are in WindowExec.scala. This file is pretty large (over 1k loc) and has a lot of different abstractions in them. This patch

[1/2] spark git commit: [SPARK-17677][SQL] Break WindowExec.scala into multiple files

Repository: spark Updated Branches: refs/heads/master 2ab24a7bf -> 67c73052b http://git-wip-us.apache.org/repos/asf/spark/blob/67c73052/sql/core/src/main/scala/org/apache/spark/sql/execution/window/WindowFunctionFrame.scala --

spark git commit: [SPARK-17618] Fix invalid comparisons between UnsafeRow and other row formats

Repository: spark Updated Branches: refs/heads/branch-1.6 7aded55e7 -> e2ce0caed [SPARK-17618] Fix invalid comparisons between UnsafeRow and other row formats ## What changes were proposed in this pull request? This patch addresses a correctness bug in Spark 1.6.x in where `coalesce()`

spark git commit: [SPARK-17660][SQL] DESC FORMATTED for VIEW Lacks View Definition

Repository: spark Updated Branches: refs/heads/master 120723f93 -> 2ab24a7bf [SPARK-17660][SQL] DESC FORMATTED for VIEW Lacks View Definition ### What changes were proposed in this pull request? Before this PR, `DESC FORMATTED` does not have a section for the view definition. We should add

spark git commit: [SPARK-17682][SQL] Mark children as final for unary, binary, leaf expressions and plan nodes

Repository: spark Updated Branches: refs/heads/master 2cac3b2d4 -> 120723f93 [SPARK-17682][SQL] Mark children as final for unary, binary, leaf expressions and plan nodes ## What changes were proposed in this pull request? This patch marks the children method as final in unary, binary, and

spark git commit: [SPARK-16516][SQL] Support for pushing down filters for decimal and timestamp types in ORC

Repository: spark Updated Branches: refs/heads/master 5de1737b0 -> 2cac3b2d4 [SPARK-16516][SQL] Support for pushing down filters for decimal and timestamp types in ORC ## What changes were proposed in this pull request? It seems ORC supports all the types in

spark git commit: [SPARK-16777][SQL] Do not use deprecated listType API in ParquetSchemaConverter

Repository: spark Updated Branches: refs/heads/master 6a68c5d7b -> 5de1737b0 [SPARK-16777][SQL] Do not use deprecated listType API in ParquetSchemaConverter ## What changes were proposed in this pull request? This PR removes build waning as below. ```scala [WARNING]

spark git commit: [SPARK-16757] Set up Spark caller context to HDFS and YARN

Repository: spark Updated Branches: refs/heads/master 7f16affa2 -> 6a68c5d7b [SPARK-16757] Set up Spark caller context to HDFS and YARN ## What changes were proposed in this pull request? 1. Pass `jobId` to Task. 2. Invoke Hadoop APIs. * A new function `setCallerContext` is added in

spark git commit: [SPARK-17138][ML][MLIB] Add Python API for multinomial logistic regression

Repository: spark Updated Branches: refs/heads/master 85b0a1575 -> 7f16affa2 [SPARK-17138][ML][MLIB] Add Python API for multinomial logistic regression ## What changes were proposed in this pull request? Add Python API for multinomial logistic regression. - add `family` param in python api.

spark git commit: [SPARK-15962][SQL] Introduce implementation with a dense format for UnsafeArrayData

Repository: spark Updated Branches: refs/heads/master 6ee28423a -> 85b0a1575 [SPARK-15962][SQL] Introduce implementation with a dense format for UnsafeArrayData ## What changes were proposed in this pull request? This PR introduces more compact representation for ```UnsafeArrayData```.

spark git commit: Fix two comments since Actor is not used anymore.

Repository: spark Updated Branches: refs/heads/master 93c743f1a -> 6ee28423a Fix two comments since Actor is not used anymore. ## What changes were proposed in this pull request? Fix two comments since Actor is not used anymore. Author: Ding Fei Closes #15251 from