spark git commit: [SPARK-21619][SQL] Fail the execution of canonicalized plans explicitly

2017-10-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master c42d208e1 -> d28d5732a [SPARK-21619][SQL] Fail the execution of canonicalized plans explicitly ## What changes were proposed in this pull request? Canonicalized plans are not supposed to be executed. I ran into a case in which there's some

spark git commit: [SPARK-22333][SQL] timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP) has conflicts with columnReference

2017-10-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 01f6ba0e7 -> c42d208e1 [SPARK-22333][SQL] timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP) has conflicts with columnReference ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-22333 In curren

spark git commit: [SPARK-22181][SQL] Adds ReplaceExceptWithFilter rule

2017-10-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 20eb95e5e -> 01f6ba0e7 [SPARK-22181][SQL] Adds ReplaceExceptWithFilter rule ## What changes were proposed in this pull request? Adds a new optimisation rule 'ReplaceExceptWithNotFilter' that replaces Except logical with Filter operator an

spark git commit: [SPARK-21911][ML][PYSPARK] Parallel Model Evaluation for ML Tuning in PySpark

2017-10-27 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master b3d8fc3dc -> 20eb95e5e [SPARK-21911][ML][PYSPARK] Parallel Model Evaluation for ML Tuning in PySpark ## What changes were proposed in this pull request? Add parallelism support for ML tuning in pyspark. ## How was this patch tested? Test

spark git commit: [SPARK-22226][SQL] splitExpression can create too many method calls in the outer class

2017-10-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 36b826f5d -> b3d8fc3dc [SPARK-6][SQL] splitExpression can create too many method calls in the outer class ## What changes were proposed in this pull request? SPARK-18016 introduced `NestedClass` to avoid that the many methods generate

spark git commit: [TRIVIAL][SQL] Code cleaning in ResolveReferences

2017-10-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 17af727e3 -> 36b826f5d [TRIVIAL][SQL] Code cleaning in ResolveReferences ## What changes were proposed in this pull request? This PR is to clean the related codes majorly based on the today's code review on https://github.com/apache/spark