spark git commit: [SPARK-20291][SQL] NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType)

2017-04-11 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.1 03a42c012 -> 46e212d2f [SPARK-20291][SQL] NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType) ## What changes were proposed in this pull request? `NaNvl(float value, null)` will be converted into `NaNvl(floa

spark git commit: [SPARK-19993][SQL] Caching logical plans containing subquery expressions does not work.

2017-04-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 8ad63ee15 -> b14bfc3f8 [SPARK-19993][SQL] Caching logical plans containing subquery expressions does not work. ## What changes were proposed in this pull request? The sameResult() method does not work when the logical plan contains subquer

spark git commit: [SPARK-20291][SQL] NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType)

2017-04-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master cde9e3284 -> 8ad63ee15 [SPARK-20291][SQL] NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType) ## What changes were proposed in this pull request? `NaNvl(float value, null)` will be converted into `NaNvl(float va

spark git commit: [MINOR][DOCS] Update supported versions for Hive Metastore

2017-04-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 6297697f9 -> cde9e3284 [MINOR][DOCS] Update supported versions for Hive Metastore ## What changes were proposed in this pull request? Since SPARK-18112 and SPARK-13446, Apache Spark starts to support reading Hive metastore 2.0 ~ 2.1.1. Th

spark git commit: [SPARK-19505][PYTHON] AttributeError on Exception.message in Python3

2017-04-11 Thread holden
Repository: spark Updated Branches: refs/heads/master 123b4fbbc -> 6297697f9 [SPARK-19505][PYTHON] AttributeError on Exception.message in Python3 ## What changes were proposed in this pull request? Added `util._message_exception` helper to use `str(e)` when `e.message` is unavailable (Python

spark git commit: [SPARK-20289][SQL] Use StaticInvoke to box primitive types

2017-04-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master cd91f9671 -> 123b4fbbc [SPARK-20289][SQL] Use StaticInvoke to box primitive types ## What changes were proposed in this pull request? Dataset typed API currently uses NewInstance to box primitive types (i.e. calling the constructor). Inste

spark git commit: [SPARK-20175][SQL] Exists should not be evaluated in Join operator

2017-04-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master c8706980a -> cd91f9671 [SPARK-20175][SQL] Exists should not be evaluated in Join operator ## What changes were proposed in this pull request? Similar to `ListQuery`, `Exists` should not be evaluated in `Join` operator too. ## How was this

spark git commit: [SPARK-20274][SQL] support compatible array element type in encoder

2017-04-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master d11ef3d77 -> c8706980a [SPARK-20274][SQL] support compatible array element type in encoder ## What changes were proposed in this pull request? This is a regression caused by SPARK-19716. Before SPARK-19716, we will cast an array field to

spark git commit: Document Master URL format in high availability set up

2017-04-11 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0d2b79642 -> d11ef3d77 Document Master URL format in high availability set up ## What changes were proposed in this pull request? Add documentation for adding master url in multi host, port format for standalone cluster with high availabi

spark git commit: [SPARK-20097][ML] Fix visibility discrepancy with numInstances and degreesOfFreedom in LR and GLR

2017-04-11 Thread mlnick
Repository: spark Updated Branches: refs/heads/master 734dfbfcf -> 0d2b79642 [SPARK-20097][ML] Fix visibility discrepancy with numInstances and degreesOfFreedom in LR and GLR ## What changes were proposed in this pull request? - made `numInstances` public in GLR - made `degreesOfFreedom` pub