spark git commit: [SPARK-22548][SQL] Incorrect nested AND expression pushed down to JDBC data source

2017-11-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 11a599bac -> df9228b49 [SPARK-22548][SQL] Incorrect nested AND expression pushed down to JDBC data source ## What changes were proposed in this pull request? Let’s say I have a nested AND expression shown below and p2 can not be pus

spark git commit: [SPARK-22548][SQL] Incorrect nested AND expression pushed down to JDBC data source

2017-11-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.1 7bdad58e2 -> a02a8bd23 [SPARK-22548][SQL] Incorrect nested AND expression pushed down to JDBC data source ## What changes were proposed in this pull request? Let’s say I have a nested AND expression shown below and p2 can not be pus

spark git commit: [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Support writing to Hive table which uses Avro schema url 'avro.schema.url'

2017-11-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 881c5c807 -> e0d7665ce [SPARK-17920][SPARK-19580][SPARK-19878][SQL] Support writing to Hive table which uses Avro schema url 'avro.schema.url' ## What changes were proposed in this pull request? SPARK-19580 Support for avro.schema.url whil

spark git commit: [SPARK-22541][SQL] Explicitly claim that Python udfs can't be conditionally executed with short-curcuit evaluation

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 41c6f3601 -> 9d45e675e [SPARK-22541][SQL] Explicitly claim that Python udfs can't be conditionally executed with short-curcuit evaluation ## What changes were proposed in this pull request? Besides conditional expressions such as `when` a

spark git commit: [SPARK-22508][SQL] Fix 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 9d45e675e -> c95771480 [SPARK-22508][SQL] Fix 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create() ## What changes were proposed in this pull request? This PR changes `GenerateUnsafeRowJoiner.create()` code generation to

spark git commit: [SPARK-22508][SQL] Fix 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 ca0257510 -> 23eb4d70a [SPARK-22508][SQL] Fix 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create() ## What changes were proposed in this pull request? This PR changes `GenerateUnsafeRowJoiner.create()` code generation

spark git commit: [SPARK-22550][SQL] Fix 64KB JVM bytecode limit problem with elt

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master c95771480 -> 9bdff0bcd [SPARK-22550][SQL] Fix 64KB JVM bytecode limit problem with elt ## What changes were proposed in this pull request? This PR changes `elt` code generation to place generated code for expression for arguments into sep

spark git commit: [SPARK-22550][SQL] Fix 64KB JVM bytecode limit problem with elt

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 23eb4d70a -> 94f9227d8 [SPARK-22550][SQL] Fix 64KB JVM bytecode limit problem with elt This PR changes `elt` code generation to place generated code for expression for arguments into separated methods if these size could be large. This

spark git commit: [SPARK-22569][SQL] Clean usage of addMutableState and splitExpressions

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 9bdff0bcd -> 96e947ed6 [SPARK-22569][SQL] Clean usage of addMutableState and splitExpressions ## What changes were proposed in this pull request? This PR is to clean the usage of addMutableState and splitExpressions 1. replace hardcoded ty

spark git commit: [MINOR][DOC] The left navigation bar should be fixed with respect to scrolling.

2017-11-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master 96e947ed6 -> 5855b5c03 [MINOR][DOC] The left navigation bar should be fixed with respect to scrolling. ## What changes were proposed in this pull request? A minor CSS style change to make Left navigation bar stay fixed with respect to scro

spark-website git commit: Fix the dead link of "Spark Summit"

2017-11-21 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site de3e0a792 -> 61d039e6c Fix the dead link of "Spark Summit" Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/61d039e6 Tree: http://git-wip-us.ap

spark git commit: [SPARK-22521][ML] VectorIndexerModel support handle unseen categories via handleInvalid: Python API

2017-11-21 Thread holden
Repository: spark Updated Branches: refs/heads/master 5855b5c03 -> 2d868d939 [SPARK-22521][ML] VectorIndexerModel support handle unseen categories via handleInvalid: Python API ## What changes were proposed in this pull request? Add python api for VectorIndexerModel support handle unseen cat

spark git commit: [SPARK-22165][SQL] Fixes type conflicts between double, long, decimals, dates and timestamps in partition column

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 2d868d939 -> 6d7ebf2f9 [SPARK-22165][SQL] Fixes type conflicts between double, long, decimals, dates and timestamps in partition column ## What changes were proposed in this pull request? This PR proposes to add a rule that re-uses `TypeC

spark git commit: [SPARK-22475][SQL] show histogram in DESC COLUMN command

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 6d7ebf2f9 -> b96f61b6b [SPARK-22475][SQL] show histogram in DESC COLUMN command ## What changes were proposed in this pull request? Added the histogram representation to the output of the `DESCRIBE EXTENDED table_name column_name` command

spark git commit: [SPARK-22500][SQL] Fix 64KB JVM bytecode limit problem with cast

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master b96f61b6b -> ac10171be [SPARK-22500][SQL] Fix 64KB JVM bytecode limit problem with cast ## What changes were proposed in this pull request? This PR changes `cast` code generation to place generated code for expression for fields of a stru

spark git commit: [SPARK-22500][SQL] Fix 64KB JVM bytecode limit problem with cast

2017-11-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 94f9227d8 -> 11a599bac [SPARK-22500][SQL] Fix 64KB JVM bytecode limit problem with cast This PR changes `cast` code generation to place generated code for expression for fields of a structure into separated methods if these size could

spark git commit: [SPARK-22548][SQL] Incorrect nested AND expression pushed down to JDBC data source

2017-11-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ac10171be -> 881c5c807 [SPARK-22548][SQL] Incorrect nested AND expression pushed down to JDBC data source ## What changes were proposed in this pull request? Let’s say I have a nested AND expression shown below and p2 can not be pushed