spark git commit: [SPARK-20156][SQL][FOLLOW-UP] Java String toLowerCase "Turkish locale bug" in Database and Table DDLs

2017-04-20 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 8d658b90b -> d01122dbc [SPARK-20156][SQL][FOLLOW-UP] Java String toLowerCase "Turkish locale bug" in Database and Table DDLs ### What changes were proposed in this pull request? Database and Table names conform the Hive standard ("[a-z

spark git commit: [SPARK-20156][SQL][FOLLOW-UP] Java String toLowerCase "Turkish locale bug" in Database and Table DDLs

2017-04-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master 46c574976 -> 55bea5691 [SPARK-20156][SQL][FOLLOW-UP] Java String toLowerCase "Turkish locale bug" in Database and Table DDLs ### What changes were proposed in this pull request? Database and Table names conform the Hive standard ("[a-zA-z_

spark git commit: [SPARK-20405][SQL] Dataset.withNewExecutionId should be private

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.2 d01122dbc -> 9fd25fbc4 [SPARK-20405][SQL] Dataset.withNewExecutionId should be private ## What changes were proposed in this pull request? Dataset.withNewExecutionId is only used in Dataset itself and should be private. ## How was this

spark git commit: [SPARK-20405][SQL] Dataset.withNewExecutionId should be private

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 55bea5691 -> c6f62c5b8 [SPARK-20405][SQL] Dataset.withNewExecutionId should be private ## What changes were proposed in this pull request? Dataset.withNewExecutionId is only used in Dataset itself and should be private. ## How was this pat

spark git commit: [SPARK-20409][SQL] fail early if aggregate function in GROUP BY

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master c6f62c5b8 -> b91873db0 [SPARK-20409][SQL] fail early if aggregate function in GROUP BY ## What changes were proposed in this pull request? It's illegal to have aggregate function in GROUP BY, and we should fail at analysis phase, if this

spark git commit: [SPARK-20409][SQL] fail early if aggregate function in GROUP BY

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.2 9fd25fbc4 -> 990452625 [SPARK-20409][SQL] fail early if aggregate function in GROUP BY ## What changes were proposed in this pull request? It's illegal to have aggregate function in GROUP BY, and we should fail at analysis phase, if t

spark git commit: [SPARK-20409][SQL] fail early if aggregate function in GROUP BY

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 9e5dc82a1 -> 66e7a8f1d [SPARK-20409][SQL] fail early if aggregate function in GROUP BY ## What changes were proposed in this pull request? It's illegal to have aggregate function in GROUP BY, and we should fail at analysis phase, if t

spark git commit: [SPARK-20407][TESTS] ParquetQuerySuite 'Enabling/disabling ignoreCorruptFiles' flaky test

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master b91873db0 -> c5a31d160 [SPARK-20407][TESTS] ParquetQuerySuite 'Enabling/disabling ignoreCorruptFiles' flaky test ## What changes were proposed in this pull request? SharedSQLContext.afterEach now calls DebugFilesystem.assertNoOpenStreams

spark git commit: [SPARK-20407][TESTS] ParquetQuerySuite 'Enabling/disabling ignoreCorruptFiles' flaky test

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.2 990452625 -> 32c5a105e [SPARK-20407][TESTS] ParquetQuerySuite 'Enabling/disabling ignoreCorruptFiles' flaky test ## What changes were proposed in this pull request? SharedSQLContext.afterEach now calls DebugFilesystem.assertNoOpenStre

spark git commit: [SPARK-20358][CORE] Executors failing stage on interrupted exception thrown by cancelled tasks

2017-04-20 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.2 32c5a105e -> e929cd767 [SPARK-20358][CORE] Executors failing stage on interrupted exception thrown by cancelled tasks ## What changes were proposed in this pull request? This was a regression introduced by my earlier PR here: https:/

spark git commit: [SPARK-20358][CORE] Executors failing stage on interrupted exception thrown by cancelled tasks

2017-04-20 Thread yhuai
Repository: spark Updated Branches: refs/heads/master c5a31d160 -> b2ebadfd5 [SPARK-20358][CORE] Executors failing stage on interrupted exception thrown by cancelled tasks ## What changes were proposed in this pull request? This was a regression introduced by my earlier PR here: https://git

spark git commit: [SPARK-20334][SQL] Return a better error message when correlated predicates contain aggregate expression that has mixture of outer and local references.

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master b2ebadfd5 -> d95e4d9d6 [SPARK-20334][SQL] Return a better error message when correlated predicates contain aggregate expression that has mixture of outer and local references. ## What changes were proposed in this pull request? Address a f

spark git commit: [SPARK-20410][SQL] Make sparkConf a def in SharedSQLContext

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master d95e4d9d6 -> 033206355 [SPARK-20410][SQL] Make sparkConf a def in SharedSQLContext ## What changes were proposed in this pull request? It is kind of annoying that `SharedSQLContext.sparkConf` is a val when overriding test cases, because yo

spark git commit: [SPARK-20410][SQL] Make sparkConf a def in SharedSQLContext

2017-04-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.2 e929cd767 -> 01f62625c [SPARK-20410][SQL] Make sparkConf a def in SharedSQLContext ## What changes were proposed in this pull request? It is kind of annoying that `SharedSQLContext.sparkConf` is a val when overriding test cases, becaus

spark git commit: [SPARK-20172][CORE] Add file permission check when listing files in FsHistoryProvider

2017-04-20 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 033206355 -> 592f5c893 [SPARK-20172][CORE] Add file permission check when listing files in FsHistoryProvider ## What changes were proposed in this pull request? In the current Spark's HistoryServer we expected to get `AccessControlExcept

spark git commit: [SPARK-20172][CORE] Add file permission check when listing files in FsHistoryProvider

2017-04-20 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 01f62625c -> 7e9eba08a [SPARK-20172][CORE] Add file permission check when listing files in FsHistoryProvider ## What changes were proposed in this pull request? In the current Spark's HistoryServer we expected to get `AccessControlEx

spark git commit: [SPARK-20367] Properly unescape column names of partitioning columns parsed from paths.

2017-04-20 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 592f5c893 -> 0368eb9d8 [SPARK-20367] Properly unescape column names of partitioning columns parsed from paths. ## What changes were proposed in this pull request? When infering partitioning schema from paths, the column in parsePartition

spark git commit: [SPARK-20367] Properly unescape column names of partitioning columns parsed from paths.

2017-04-20 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 7e9eba08a -> d17dea8f1 [SPARK-20367] Properly unescape column names of partitioning columns parsed from paths. ## What changes were proposed in this pull request? When infering partitioning schema from paths, the column in parseParti

spark git commit: [SPARK-20329][SQL] Make timezone aware expression without timezone unresolved

2017-04-20 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 0368eb9d8 -> 760c8d088 [SPARK-20329][SQL] Make timezone aware expression without timezone unresolved ## What changes were proposed in this pull request? A cast expression with a resolved time zone is not equal to a cast expression without

spark git commit: [SPARK-20329][SQL] Make timezone aware expression without timezone unresolved

2017-04-20 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 d17dea8f1 -> 5ce76804c [SPARK-20329][SQL] Make timezone aware expression without timezone unresolved ## What changes were proposed in this pull request? A cast expression with a resolved time zone is not equal to a cast expression with

spark git commit: [SPARK-20281][SQL] Print the identical Range parameters of SparkContext APIs and SQL in explain

2017-04-20 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 760c8d088 -> 48d760d02 [SPARK-20281][SQL] Print the identical Range parameters of SparkContext APIs and SQL in explain ## What changes were proposed in this pull request? This pr modified code to print the identical `Range` parameters of S

spark git commit: [SPARK-20281][SQL] Print the identical Range parameters of SparkContext APIs and SQL in explain

2017-04-20 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 5ce76804c -> 6cd2f16b1 [SPARK-20281][SQL] Print the identical Range parameters of SparkContext APIs and SQL in explain ## What changes were proposed in this pull request? This pr modified code to print the identical `Range` parameters