Repository: spark
Updated Branches:
refs/heads/master 226d38840 -> 0fbecc736
[SPARK-19537] Move pendingPartitions to ShuffleMapStage.
The pendingPartitions instance variable should be moved to ShuffleMapStage,
because it is only used by ShuffleMapStages. This change is purely refactoring
and
Repository: spark
Updated Branches:
refs/heads/branch-2.1 7b5ea000e -> e580bb035
[SPARK-18717][SQL] Make code generation for Scala Map work with immutable.Map
also
## What changes were proposed in this pull request?
Fixes compile errors in generated code when user has case class with a
Repository: spark
Updated Branches:
refs/heads/master d785217b7 -> 226d38840
[SPARK-19548][SQL] Support Hive UDFs which return typed Lists/Maps
## What changes were proposed in this pull request?
This PR adds support for Hive UDFs that return fully typed java Lists or Maps,
for example
Repository: spark
Updated Branches:
refs/heads/master 3a43ae7c0 -> d785217b7
[SPARK-19549] Allow providing reason for stage/job cancelling
## What changes were proposed in this pull request?
This change add an optional argument to `SparkContext.cancelStage()` and
`SparkContext.cancelJob()`
Repository: spark
Updated Branches:
refs/heads/master de8a03e68 -> 3a43ae7c0
[SPARK-18613][ML] make spark.mllib LDA dependencies in spark.ml LDA private
## What changes were proposed in this pull request?
spark.ml.*LDAModel classes were exposing spark.mllib LDA models via protected
methods.
Repository: spark
Updated Branches:
refs/heads/master dadff5f07 -> de8a03e68
[SPARK-19459][SQL] Add Hive datatype (char/varchar) to StructField metadata
## What changes were proposed in this pull request?
Reading from an existing ORC table which contains `char` or `varchar` columns
can fail
Repository: spark
Updated Branches:
refs/heads/master 8640dc082 -> c5a66356d
Encryption of shuffle files
Hello
According to my understanding of commits
4b4e329e49f8af28fa6301bd06c48d7097eaf9e6 &
8b325b17ecdf013b7a6edcb7ee3773546bd914df, one may now encrypt shuffle files
regardless of the
Repository: spark
Updated Branches:
refs/heads/master 8e8afb3a3 -> 8640dc082
[SPARK-10748][MESOS] Log error instead of crashing Spark Mesos dispatcher when
a job is misconfigured
## What changes were proposed in this pull request?
Now handling the spark exception which gets thrown for
Repository: spark
Updated Branches:
refs/heads/master d5593f7f5 -> 8e8afb3a3
[SPARK-19545][YARN] Fix compile issue for Spark on Yarn when building against
Hadoop 2.6.0~2.6.3
## What changes were proposed in this pull request?
Due to the newly added API in Hadoop 2.6.4+, Spark builds against
Repository: spark
Updated Branches:
refs/heads/branch-2.1 ff5818b8c -> 7b5ea000e
[SPARK-19543] from_json fails when the input row is empty
## What changes were proposed in this pull request?
Using from_json on a column with an empty string results in:
java.util.NoSuchElementException: head
Repository: spark
Updated Branches:
refs/heads/master fd6c3a0b1 -> d5593f7f5
[SPARK-19543] from_json fails when the input row is empty
## What changes were proposed in this pull request?
Using from_json on a column with an empty string results in:
java.util.NoSuchElementException: head of
Repository: spark
Updated Branches:
refs/heads/branch-2.1 a3d5300a0 -> ff5818b8c
[SPARK-19512][BACKPORT-2.1][SQL] codegen for compare structs fails #16852
## What changes were proposed in this pull request?
Set currentVars to null in GenerateOrdering.genComparisons before genCode is
called.
12 matches
Mail list logo