[spark] branch master updated (876ce6a5df1 -> f98f9f85662)

2022-08-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 876ce6a5df1 [SPARK-35542][ML] Fix: Bucketizer created for multiple columns with parameters splitsArray, inputCols

[spark] branch master updated: [SPARK-40105][SQL] Improve repartition in ReplaceCTERefWithRepartition

2022-08-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 103768bcb8b [SPARK-40105][SQL] Improve

[spark] branch branch-3.2 updated: [SPARK-39887][SQL][FOLLOW-UP] Do not exclude Union's first child attributes when traversing other children in RemoveRedundantAliases

2022-08-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new f96fc06ca4a [SPARK-39887][SQL][FOLLOW

[spark] branch branch-3.3 updated: [SPARK-39887][SQL][FOLLOW-UP] Do not exclude Union's first child attributes when traversing other children in RemoveRedundantAliases

2022-08-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 9601be96a86 [SPARK-39887][SQL][FOLLOW

[spark] branch master updated (6c25ce383d1 -> e732232dac4)

2022-08-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6c25ce383d1 [SPARK-40116][R][INFRA] Pin Arrow version to 8.0.0 in AppVeyor add e732232dac4 [SPARK-39887][SQL

[spark] branch master updated: [SPARK-37980][SQL] Extend METADATA column to support row indexes for Parquet files

2022-08-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 95aebcbf100 [SPARK-37980][SQL] Extend METADATA

[spark] branch master updated (0503e10b819 -> 37c421aa5c7)

2022-08-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0503e10b819 [SPARK-40067][SQL] Use Table#name() instead of Scan#name() to populate the table name in the BatchScan

[spark] branch master updated (dd929b04df6 -> 0503e10b819)

2022-08-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from dd929b04df6 [SPARK-40095][PYTHON] sc.uiWebUrl should not throw exception when webui is disabled add 0503e10b819

[spark] branch branch-3.1 updated: [SPARK-39887][SQL][3.1] RemoveRedundantAliases should keep aliases that make the output of projection nodes unique

2022-08-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new de68152f01c [SPARK-39887][SQL][3.1

[spark] branch master updated: [SPARK-40019][SQL] Refactor comment of ArrayType's containsNull and refactor the misunderstanding logics in collectionOperator's expression about `containsNull`

2022-08-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f66bcd4fba8 [SPARK-40019][SQL] Refactor comment

[spark] branch master updated (87094f89655 -> c7c03f1c75d)

2022-08-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 87094f89655 [SPARK-40079] Add Imputer inputCols validation for empty input case add c7c03f1c75d [SPARK-40073

[spark] branch branch-3.3 updated: [SPARK-39976][SQL] ArrayIntersect should handle null in left expression correctly

2022-08-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new d7af1d20f06 [SPARK-39976][SQL

[spark] branch master updated: [SPARK-39976][SQL] ArrayIntersect should handle null in left expression correctly

2022-08-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dff5c2f2e9c [SPARK-39976][SQL] ArrayIntersect

[spark] branch branch-3.3 updated (221fee8973c -> 21d9db39b7a)

2022-08-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git from 221fee8973c [SPARK-40047][TEST] Exclude unused `xalan` transitive dependency from `htmlunit` add

[spark] branch master updated: [SPARK-40020][SQL] Centralize the code of qualifying identifiers in SessionCatalog

2022-08-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new abaec2804fb [SPARK-40020][SQL] Centralize

[spark] branch master updated: [SPARK-38899][SQL][FOLLOWUP] Fix bug extract datetime in DS V2 pushdown

2022-08-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5dadf52beb8 [SPARK-38899][SQL][FOLLOWUP] Fix

[spark] branch master updated (ee2bf788ea3 -> 36a269d1ce6)

2022-08-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ee2bf788ea3 [SPARK-40008][SQL][FOLLOWUP] Fix codegen of casting integrals to ANSI intervals add 36a269d1ce6

[spark] branch master updated: [SPARK-39929][SQL] DS V2 supports push down string functions(non ANSI)

2022-08-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3b2169129df [SPARK-39929][SQL] DS V2 supports

[spark] branch master updated (b012cb722f6 -> 07a5e5f53b1)

2022-08-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b012cb722f6 [SPARK-40007][PYTHON][SQL] Add 'mode' to functions add 07a5e5f53b1 [SPARK-39819][SQL] DS V2

[spark] branch master updated: [SPARK-39912][SPARK-39828][SQL] Refine CatalogImpl

2022-08-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5c9175c9da7 [SPARK-39912][SPARK-39828][SQL

[spark] branch master updated (bf42b891cf5 -> b02316ccf3e)

2022-08-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from bf42b891cf5 [MINOR][SQL] Improve the comments about null tracking for UnsafeRow add b02316ccf3e [SPARK-39764

[spark] branch master updated: [MINOR][SQL] Improve the comments about null tracking for UnsafeRow

2022-08-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bf42b891cf5 [MINOR][SQL] Improve the comments

[spark] branch branch-3.2 updated: [SPARK-38034][SQL] Optimize TransposeWindow rule

2022-08-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 0f609ffe86b [SPARK-38034][SQL] Optimize

[spark] branch branch-3.3 updated: [SPARK-38034][SQL] Optimize TransposeWindow rule

2022-08-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 369b01404c2 [SPARK-38034][SQL] Optimize

[spark] branch master updated: [SPARK-38034][SQL] Optimize TransposeWindow rule

2022-08-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0cc331dc7e5 [SPARK-38034][SQL] Optimize

[spark] branch master updated: [SPARK-39964][SQL] DS V2 pushdown should unify the translate path

2022-08-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new de1d366b275 [SPARK-39964][SQL] DS V2 pushdown

[spark] branch master updated (8a0e299947c -> 4a7e92dc41e)

2022-08-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8a0e299947c [SPARK-38901][SQL] DS V2 supports push down misc functions add 4a7e92dc41e [SPARK-39963][SQL

[spark] branch master updated: [SPARK-38901][SQL] DS V2 supports push down misc functions

2022-08-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8a0e299947c [SPARK-38901][SQL] DS V2 supports

[spark] branch branch-3.1 updated: [SPARK-39867][SQL][3.1] Global limit should not inherit OrderPreservingUnaryNode

2022-08-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new a25394ad775 [SPARK-39867][SQL][3.1

[spark] branch branch-3.2 updated: [SPARK-39867][SQL][3.2] Global limit should not inherit OrderPreservingUnaryNode

2022-08-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 7a254d99b72 [SPARK-39867][SQL][3.2

[spark] branch branch-3.2 updated: [SPARK-39775][CORE][AVRO] Disable validate default values when parsing Avro schemas

2022-08-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 0e5812c49d2 [SPARK-39775][CORE][AVRO

[spark] branch branch-3.3 updated: [SPARK-39775][CORE][AVRO] Disable validate default values when parsing Avro schemas

2022-08-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new c358ee67615 [SPARK-39775][CORE][AVRO

[spark] branch master updated (82dc17cdf7a -> 5c1b99f441e)

2022-08-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 82dc17cdf7a [SPARK-39986][PS][DOC] Better example for Co-grouped Map add 5c1b99f441e [SPARK-39775][CORE][AVRO

[spark] branch master updated: [SPARK-39936][SQL] Store schema in properties for Spark Views

2022-08-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 047c7c2ed9f [SPARK-39936][SQL] Store schema

[spark] branch branch-3.1 updated: [SPARK-39952][SQL] SaveIntoDataSourceCommand should recache result relation

2022-08-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 9605dde3c04 [SPARK-39952][SQL

[spark] branch branch-3.2 updated: [SPARK-39952][SQL] SaveIntoDataSourceCommand should recache result relation

2022-08-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 7d9cbf5e443 [SPARK-39952][SQL

[spark] branch branch-3.3 updated: [SPARK-39952][SQL] SaveIntoDataSourceCommand should recache result relation

2022-08-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 15ebd56de6a [SPARK-39952][SQL

[spark] branch master updated (5412688cd69 -> 5fe0b245f78)

2022-08-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5412688cd69 [SPARK-39928][CORE] Optimize `Utils.getIteratorSize` for Scala 2.13 refer to `IterableOnceOps.size

[spark] branch branch-3.3 updated: [SPARK-39867][SQL] Global limit should not inherit OrderPreservingUnaryNode

2022-08-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 2254240dba4 [SPARK-39867][SQL] Global

[spark] branch master updated: [SPARK-39867][SQL] Global limit should not inherit OrderPreservingUnaryNode

2022-08-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e9cc1024df4 [SPARK-39867][SQL] Global limit

[spark] branch branch-3.2 updated (d4f6541d767 -> 265bd219071)

2022-08-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git from d4f6541d767 [SPARK-39932][SQL] WindowExec should clear the final partition buffer add 265bd219071 [SPARK

[spark] branch branch-3.1 updated: [SPARK-39835][SQL][3.1] Fix EliminateSorts remove global sort below the local sort

2022-08-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 586ccce83c8 [SPARK-39835][SQL][3.1] Fix

[spark] branch branch-3.3 updated (41779ea2612 -> ea6d57715fd)

2022-08-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git from 41779ea2612 [MINOR][DOCS] Remove generated statement about Scala version in docs homepage as Spark supports

[spark] branch master updated (957eb7a7273 -> d2a18417d90)

2022-08-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 957eb7a7273 [SPARK-39933][SQL][TESTS] Check query context by `checkError()` add d2a18417d90 [SPARK-39873][SQL

[spark] branch master updated (3021eb197f4 -> 83bd4f3133b)

2022-07-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3021eb197f4 [SPARK-39907][PS] Implement axis and skipna of Series.argmin add 83bd4f3133b [SPARK-39911][SQL

[spark] branch master updated: [SPARK-39849][SQL] Dataset.as(StructType) fills missing new columns with null value

2022-07-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 93cf0df6d9e [SPARK-39849][SQL] Dataset.as

[spark] branch master updated (25009eac9bc -> e187bb3940a)

2022-07-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 25009eac9bc [SPARK-39918][SQL][MINOR] Replace the wording "un-comparable" with "incomparable&qu

[spark] branch master updated (0f9c1a2e848 -> f49411e3cf5)

2022-07-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0f9c1a2e848 [SPARK-39844][SQL] Update SQLConf for DEFAULT column providers to allow/deny "ALTER TABLE ... ADD C

[spark] branch master updated: [SPARK-39890][SQL] Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

2022-07-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d1ca0ea4ae5 [SPARK-39890][SQL] Make

[spark] branch master updated (c608ae2fc6a -> 19df569ba61)

2022-07-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c608ae2fc6a [SPARK-39839][SQL] Handle special case of null variable-length Decimal with non-zero offsetAndSize

[spark] branch master updated: [SPARK-39731][SQL] Fix issue in CSV and JSON data sources when parsing dates in "yyyyMMdd" format with CORRECTED time parser policy

2022-07-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a9304455025 [SPARK-39731][SQL] Fix issue in CSV

[spark] branch master updated: [SPARK-38864][SQL] Add unpivot / melt to Dataset

2022-07-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 55c3347c48f [SPARK-38864][SQL] Add unpivot

[spark] branch master updated (72b55ccf832 -> 5c0d5515956)

2022-07-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 72b55ccf832 [SPARK-39856][SQL][TESTS][FOLLOW-UP] Increase the number of partitions in TPC-DS build to avoid out

[spark] branch master updated: [SPARK-39858][SQL] Remove unnecessary `AliasHelper` or `PredicateHelper` for some rules

2022-07-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c00c0c4963f [SPARK-39858][SQL] Remove

[spark] branch branch-3.3 updated: [SPARK-39835][SQL] Fix EliminateSorts remove global sort below the local sort

2022-07-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 7603f8d0aeb [SPARK-39835][SQL] Fix

[spark] branch master updated: [SPARK-39835][SQL] Fix EliminateSorts remove global sort below the local sort

2022-07-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5dca26d514a [SPARK-39835][SQL] Fix

[spark] branch master updated (d1975a1da3f -> 6bd09ab92c2)

2022-07-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d1975a1da3f [SPARK-39836][SQL] Simplify V2ExpressionBuilder by extract common method add 6bd09ab92c2 [SPARK

[spark] branch master updated: [SPARK-39836][SQL] Simplify V2ExpressionBuilder by extract common method

2022-07-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d1975a1da3f [SPARK-39836][SQL] Simplify

[spark] branch master updated: [SPARK-39469][SQL] Infer date type for CSV schema inference

2022-07-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c2536a7eabd [SPARK-39469][SQL] Infer date type

[spark] branch master updated: [SPARK-39810][SQL] Catalog.tableExists should handle nested namespace

2022-07-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0cc96f76d8a [SPARK-39810][SQL

[spark] branch master updated: [SPARK-39148][SQL] DS V2 aggregate push down can work with OFFSET or LIMIT

2022-07-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aec79534abf [SPARK-39148][SQL] DS V2 aggregate

[spark] branch master updated: [SPARK-37287][SQL] Pull out dynamic partition and bucket sort from FileFormatWriter

2022-07-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 256227477b0 [SPARK-37287][SQL] Pull out dynamic

[spark] branch branch-3.3 updated: [SPARK-39806][SQL] Accessing `_metadata` on partitioned table can crash a query

2022-07-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new aeafb175875 [SPARK-39806][SQL

[spark] branch master updated: [SPARK-39806][SQL] Accessing `_metadata` on partitioned table can crash a query

2022-07-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 385f1c8e403 [SPARK-39806][SQL] Accessing

[spark] branch master updated: [SPARK-39773][SQL][DOCS] Update document of JDBC options for `pushDownOffset`

2022-07-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 187d43da7a0 [SPARK-39773][SQL][DOCS] Update

[spark] branch master updated (140c8018834 -> 0d4fb414cea)

2022-07-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 140c8018834 [SPARK-39625][SPARK-38904][SQL] Add Dataset.as(StructType) add 0d4fb414cea [SPARK-39788][SQL] Rename

[spark] branch master updated: [SPARK-39625][SPARK-38904][SQL] Add Dataset.as(StructType)

2022-07-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 140c8018834 [SPARK-39625][SPARK-38904][SQL] Add

[spark] branch master updated: [SPARK-39741][SQL] Support url encode/decode as built-in function and tidy up url-related functions

2022-07-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e5c1b822016 [SPARK-39741][SQL] Support url

[spark] branch master updated: [SPARK-39772][SQL] namespace should be null when database is null in the old constructors

2022-07-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 35d00df9bba [SPARK-39772][SQL] namespace should

[spark] branch master updated: [SPARK-39767][SQL] Remove UnresolvedDBObjectName and add UnresolvedIdentifier

2022-07-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fc157d8d490 [SPARK-39767][SQL] Remove

[spark] branch master updated: [SPARK-39672][SQL][3.1] Fix removing project before filter with correlated subquery

2022-07-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c8c280cb631 [SPARK-39672][SQL][3.1] Fix

[spark] branch branch-3.3 updated: [SPARK-39672][SQL][3.1] Fix removing project before filter with correlated subquery

2022-07-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 2fe16015cdd [SPARK-39672][SQL][3.1] Fix

[spark] branch branch-3.2 updated: [SPARK-39672][SQL][3.1] Fix removing project before filter with correlated subquery

2022-07-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 816682e593d [SPARK-39672][SQL][3.1] Fix

[spark] branch branch-3.1 updated: [SPARK-39672][SQL][3.1] Fix removing project before filter with correlated subquery

2022-07-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 36fc73e7c42 [SPARK-39672][SQL][3.1] Fix

[spark] branch master updated: [SPARK-39751][SQL] Rename hash aggregate key probes metric

2022-07-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 899f6c90eb2 [SPARK-39751][SQL] Rename hash

[spark] branch master updated: [SPARK-39385][SQL] Supports push down `REGR_AVGX` and `REGR_AVGY`

2022-07-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a79c91ec341 [SPARK-39385][SQL] Supports push

[spark] branch master updated: [SPARK-39651][SQL] Prune filter condition if compare with rand is deterministic

2022-07-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c800d296eb0 [SPARK-39651][SQL] Prune filter

[spark] branch master updated: [SPARK-39699][SQL] Make CollapseProject smarter about collection creation expressions

2022-07-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8749c17c200 [SPARK-39699][SQL] Make

[spark] branch master updated: [SPARK-35208][SQL][DOCS] Add docs for LATERAL subqueries

2022-07-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ec894138344 [SPARK-35208][SQL][DOCS] Add docs

[spark] branch master updated: [SPARK-39737][SQL] `PERCENTILE_CONT` and `PERCENTILE_DISC` should support aggregate filter

2022-07-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ab277e123c5 [SPARK-39737][SQL] `PERCENTILE_CONT

[spark] branch master updated (757e6514b09 -> 7a4b93dff9c)

2022-07-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 757e6514b09 [SPARK-39713][SQL] ANSI mode: add suggestion of using try_element_at for INVALID_ARRAY_INDEX error

[spark] branch master updated: [SPARK-38899][SQL] DS V2 supports push down datetime functions

2022-07-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1df405fb122 [SPARK-38899][SQL] DS V2 supports

[spark] branch master updated (fe7b8fcd6fe -> 7dcb4bafd02)

2022-07-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fe7b8fcd6fe [SPARK-33753][CORE] Reduce the memory footprint and gc of the cache (hadoopJobMetadata) add

[spark] branch branch-3.2 updated (32aff86477a -> c5983c1691f)

2022-07-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git from 32aff86477a [SPARK-39447][SQL][3.2] Avoid AssertionError in AdaptiveSparkPlanExec.doExecuteBroadcast add

[spark] branch branch-3.2 updated: [SPARK-39447][SQL][3.2] Avoid AssertionError in AdaptiveSparkPlanExec.doExecuteBroadcast

2022-07-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 32aff86477a [SPARK-39447][SQL][3.2

[spark] branch master updated (5adcddb87a0 -> fe7b8fcd6fe)

2022-07-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5adcddb87a0 [SPARK-39695][SQL] Add the `REGEXP_SUBSTR` function add fe7b8fcd6fe [SPARK-33753][CORE] Reduce

[spark] branch master updated: [SPARK-39679][SQL] TakeOrderedAndProjectExec should respect child output ordering

2022-07-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 427fbee4c00 [SPARK-39679][SQL

[spark] branch branch-3.3 updated: [SPARK-37527][SQL][FOLLOWUP] Cannot compile COVAR_POP, COVAR_SAMP and CORR in `H2Dialect` if them with `DISTINCT`

2022-07-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 016dfeb760d [SPARK-37527][SQL][FOLLOWUP

[spark] branch master updated: [SPARK-37527][SQL][FOLLOWUP] Cannot compile COVAR_POP, COVAR_SAMP and CORR in `H2Dialect` if them with `DISTINCT`

2022-07-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 14f2bae208c [SPARK-37527][SQL][FOLLOWUP] Cannot

[spark] branch master updated: [SPARK-39564][SQL][FOLLOWUP] Consider the case of serde available in CatalogTable on explain string for LogicalRelation

2022-07-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b37defef418 [SPARK-39564][SQL][FOLLOWUP

[spark] branch master updated: [SPARK-39453][SQL][TESTS][FOLLOWUP] Let `RAND` in filter is more meaningful

2022-07-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3c9b296928a [SPARK-39453][SQL][TESTS][FOLLOWUP

[spark] branch branch-3.3 updated: [SPARK-39447][SQL] Avoid AssertionError in AdaptiveSparkPlanExec.doExecuteBroadcast

2022-07-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 3e28f338fad [SPARK-39447][SQL] Avoid

[spark] branch master updated: [SPARK-39447][SQL] Avoid AssertionError in AdaptiveSparkPlanExec.doExecuteBroadcast

2022-07-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c320a5d51b2 [SPARK-39447][SQL] Avoid

[spark] branch master updated: [SPARK-39579][SQL][PYTHON][R] Make ListFunctions/getFunction/functionExists compatible with 3 layer namespace

2022-07-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a2c10380314 [SPARK-39579][SQL][PYTHON][R] Make

[spark] branch branch-3.1 updated (b324b610354 -> cc8ab362798)

2022-07-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git from b324b610354 [SPARK-39621][PYTHON][TESTS] Make `run-tests.py` robust by avoiding `rmtree` on MacOS add

[spark] branch master updated: [SPARK-39649][PYTHON] Make listDatabases / getDatabase / listColumns / refreshTable in PySpark support 3-layer-namespace

2022-07-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6e7a571532e [SPARK-39649][PYTHON] Make

[spark] branch master updated: [SPARK-28516][SQL][FOLLOWUP] Remove try_to_char function

2022-07-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 196095e7b96 [SPARK-28516][SQL][FOLLOWUP] Remove

[spark] branch master updated: [SPARK-39656][SQL] Fix wrong namespace in DescribeNamespaceExec

2022-07-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a2e333e4c16 [SPARK-39656][SQL] Fix wrong

[spark] branch master updated (f8a377527c8 -> e261f8630c7)

2022-07-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f8a377527c8 [SPARK-39503][SQL] Add session catalog name for v1 database table and function add e261f8630c7

[spark] branch master updated (09d1bae95be -> f8a377527c8)

2022-07-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 09d1bae95be [SPARK-38796][SQL] Update documentation for number format strings with the {try_}to_number functions

<    5   6   7   8   9   10   11   12   13   14   >