[jira] [Created] (SPARK-46207) Support MergeInto in DataFrameWriterV2

Huaxin Gao created SPARK-46207: -- Summary: Support MergeInto in DataFrameWriterV2 Key: SPARK-46207 URL: https://issues.apache.org/jira/browse/SPARK-46207 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-44060) Code-gen for build side outer shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-44060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-44060: -- Assignee: Szehon Ho > Code-gen for build side outer shuffled hash join >

[jira] [Resolved] (SPARK-44060) Code-gen for build side outer shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-44060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-44060. Fix Version/s: 3.5.0 Resolution: Fixed > Code-gen for build side outer shuffled hash join

[jira] [Created] (SPARK-44149) Support DataFrame Merge API

Huaxin Gao created SPARK-44149: -- Summary: Support DataFrame Merge API Key: SPARK-44149 URL: https://issues.apache.org/jira/browse/SPARK-44149 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43417) Improve CBO stats

Huaxin Gao created SPARK-43417: -- Summary: Improve CBO stats Key: SPARK-43417 URL: https://issues.apache.org/jira/browse/SPARK-43417 Project: Spark Issue Type: New Feature Components:

[jira] [Resolved] (SPARK-42470) Remove unused declarations from Hive module

[ https://issues.apache.org/jira/browse/SPARK-42470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-42470. Fix Version/s: 3.5.0 Assignee: Yang Jie Resolution: Fixed > Remove unused

[jira] [Assigned] (SPARK-40045) The order of filtering predicates is not reasonable

[ https://issues.apache.org/jira/browse/SPARK-40045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-40045: -- Assignee: caican > The order of filtering predicates is not reasonable >

[jira] [Resolved] (SPARK-42188) Force SBT protobuf version to match Maven on branch 3.2 and 3.3

[ https://issues.apache.org/jira/browse/SPARK-42188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-42188. Assignee: Steve Vaughan Resolution: Fixed > Force SBT protobuf version to match Maven on

[jira] [Resolved] (SPARK-42134) Fix getPartitionFiltersAndDataFilters() to handle filters without referenced attributes

[ https://issues.apache.org/jira/browse/SPARK-42134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-42134. Fix Version/s: 3.3.2 3.4.0 Assignee: Peter Toth Resolution:

[jira] [Resolved] (SPARK-42031) Clean up remove methods that do not need override

[ https://issues.apache.org/jira/browse/SPARK-42031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-42031. Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed > Clean up remove

[jira] [Created] (SPARK-41378) Support Column Stats in DS V2

Huaxin Gao created SPARK-41378: -- Summary: Support Column Stats in DS V2 Key: SPARK-41378 URL: https://issues.apache.org/jira/browse/SPARK-41378 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-40946) Introduce a new DataSource V2 interface SupportsPushDownClusterKeys

Huaxin Gao created SPARK-40946: -- Summary: Introduce a new DataSource V2 interface SupportsPushDownClusterKeys Key: SPARK-40946 URL: https://issues.apache.org/jira/browse/SPARK-40946 Project: Spark

[jira] [Updated] (SPARK-40429) Only set KeyGroupedPartitioning when the referenced column is in the output

[ https://issues.apache.org/jira/browse/SPARK-40429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-40429: --- Description: {code:java} sql(s"CREATE TABLE $tbl (id bigint, data string) PARTITIONED BY

[jira] [Created] (SPARK-40429) Only set KeyGroupedPartitioning when the referenced column is in the output

Huaxin Gao created SPARK-40429: -- Summary: Only set KeyGroupedPartitioning when the referenced column is in the output Key: SPARK-40429 URL: https://issues.apache.org/jira/browse/SPARK-40429 Project:

[jira] [Created] (SPARK-40293) Make the V2 table error message more meaningful

Huaxin Gao created SPARK-40293: -- Summary: Make the V2 table error message more meaningful Key: SPARK-40293 URL: https://issues.apache.org/jira/browse/SPARK-40293 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40113) Reactor ParquetScanBuilder DataSourceV2 interface implementation

[ https://issues.apache.org/jira/browse/SPARK-40113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-40113. Fix Version/s: 3.4.0 Assignee: miracle Resolution: Fixed > Reactor

[jira] [Resolved] (SPARK-40064) Use V2 Filter in SupportsOverwrite

[ https://issues.apache.org/jira/browse/SPARK-40064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-40064. Fix Version/s: 3.4.0 Assignee: Huaxin Gao Resolution: Fixed > Use V2 Filter in

[jira] [Created] (SPARK-40064) Use V2 Filter in SupportsOverwrite

Huaxin Gao created SPARK-40064: -- Summary: Use V2 Filter in SupportsOverwrite Key: SPARK-40064 URL: https://issues.apache.org/jira/browse/SPARK-40064 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-39528) Use V2 Filter in SupportsRuntimeFiltering

[ https://issues.apache.org/jira/browse/SPARK-39528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-39528: --- Parent: SPARK-36555 Issue Type: Sub-task (was: Improvement) > Use V2 Filter in

[jira] [Updated] (SPARK-39966) Use V2 Filter in SupportsDelete

[ https://issues.apache.org/jira/browse/SPARK-39966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-39966: --- Parent: SPARK-36555 Issue Type: Sub-task (was: Improvement) > Use V2 Filter in

[jira] [Resolved] (SPARK-39966) Use V2 Filter in SupportsDelete

[ https://issues.apache.org/jira/browse/SPARK-39966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39966. Fix Version/s: 3.4.0 Assignee: Huaxin Gao (was: Apache Spark) Resolution: Fixed

[jira] [Created] (SPARK-39966) Use V2 Filter in SupportsDelete

Huaxin Gao created SPARK-39966: -- Summary: Use V2 Filter in SupportsDelete Key: SPARK-39966 URL: https://issues.apache.org/jira/browse/SPARK-39966 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-39914) Add DS V2 Filter to V1 Filter conversion

[ https://issues.apache.org/jira/browse/SPARK-39914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39914. Fix Version/s: 3.4.0 Assignee: Huaxin Gao Resolution: Fixed > Add DS V2 Filter to

[jira] [Resolved] (SPARK-39909) Organize the check of push down information for JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-39909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39909. Fix Version/s: 3.4.0 Resolution: Fixed > Organize the check of push down information for

[jira] [Assigned] (SPARK-39909) Organize the check of push down information for JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-39909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-39909: -- Assignee: miracle > Organize the check of push down information for JDBCV2Suite >

[jira] [Commented] (SPARK-39909) Organize the check of push down information for JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-39909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573091#comment-17573091 ] Huaxin Gao commented on SPARK-39909: Hi Chen Liang, do you have a jira id? > Organize the check of

[jira] [Updated] (SPARK-39914) Add DS V2 Filter to V1 Filter conversion

[ https://issues.apache.org/jira/browse/SPARK-39914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-39914: --- Summary: Add DS V2 Filter to V1 Filter conversion (was: Add DS V2 Filter to V2 Filter conversion)

[jira] [Created] (SPARK-39914) Add DS V2 Filter to V2 Filter conversion

Huaxin Gao created SPARK-39914: -- Summary: Add DS V2 Filter to V2 Filter conversion Key: SPARK-39914 URL: https://issues.apache.org/jira/browse/SPARK-39914 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39857) V2ExpressionBuilder uses the wrong LiteralValue data type for In predicate

Huaxin Gao created SPARK-39857: -- Summary: V2ExpressionBuilder uses the wrong LiteralValue data type for In predicate Key: SPARK-39857 URL: https://issues.apache.org/jira/browse/SPARK-39857 Project:

[jira] [Resolved] (SPARK-39812) Simplify code to construct AggregateExpression with toAggregateExpression

[ https://issues.apache.org/jira/browse/SPARK-39812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39812. Fix Version/s: 3.4.0 Assignee: jiaan.geng Resolution: Fixed > Simplify code to

[jira] [Resolved] (SPARK-39784) Put Literal values on the right side of the data source filter after translating Catalyst Expression to data source filter

[ https://issues.apache.org/jira/browse/SPARK-39784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39784. Fix Version/s: 3.4.0 Assignee: Huaxin Gao Resolution: Fixed > Put Literal values

[jira] [Resolved] (SPARK-39759) Implement listIndexes in JDBC (H2 dialect)

[ https://issues.apache.org/jira/browse/SPARK-39759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39759. Assignee: BingKun Pan Resolution: Fixed > Implement listIndexes in JDBC (H2 dialect) >

[jira] [Created] (SPARK-39784) Literal values should be on the right side of the data source filter

Huaxin Gao created SPARK-39784: -- Summary: Literal values should be on the right side of the data source filter Key: SPARK-39784 URL: https://issues.apache.org/jira/browse/SPARK-39784 Project: Spark

[jira] [Resolved] (SPARK-39704) Implement createIndex & dropIndex & IndexExists in JDBC (H2 dialect)

[ https://issues.apache.org/jira/browse/SPARK-39704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39704. Fix Version/s: 3.4.0 Assignee: BingKun Pan Resolution: Fixed > Implement

[jira] [Resolved] (SPARK-39711) Remove redundant trait: BeforeAndAfterAll & BeforeAndAfterEach & Logging

[ https://issues.apache.org/jira/browse/SPARK-39711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39711. Fix Version/s: 3.4.0 Assignee: BingKun Pan Resolution: Fixed > Remove redundant

[jira] [Resolved] (SPARK-39724) Remove duplicate `.setAccessible(true)` in `kvstore.KVTypeInfo`

[ https://issues.apache.org/jira/browse/SPARK-39724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39724. Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed > Remove duplicate

[jira] [Resolved] (SPARK-39633) Dataframe options for time travel via `timestampAsOf` should respect both formats of specifying timestamp

[ https://issues.apache.org/jira/browse/SPARK-39633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39633. Fix Version/s: 3.4.0 3.3.0 Assignee: Prashant Singh Resolution:

[jira] [Updated] (SPARK-39633) Dataframe options for time travel via `timestampAsOf` should respect both formats of specifying timestamp

[ https://issues.apache.org/jira/browse/SPARK-39633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-39633: --- Issue Type: Improvement (was: Bug) > Dataframe options for time travel via `timestampAsOf` should

[jira] [Created] (SPARK-39528) Use V2 Filter in SupportsRuntimeFiltering

Huaxin Gao created SPARK-39528: -- Summary: Use V2 Filter in SupportsRuntimeFiltering Key: SPARK-39528 URL: https://issues.apache.org/jira/browse/SPARK-39528 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-39417) Handle Null partition values in PartitioningUtils

[ https://issues.apache.org/jira/browse/SPARK-39417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39417. Fix Version/s: 3.3.0 3.4.0 Resolution: Fixed > Handle Null partition

[jira] [Resolved] (SPARK-39393) Parquet data source only supports push-down predicate filters for non-repeated primitive types

[ https://issues.apache.org/jira/browse/SPARK-39393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39393. Fix Version/s: 3.1.3 3.3.0 3.2.2 3.4.0

[jira] [Resolved] (SPARK-39413) Capitalize sql keywords in JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-39413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39413. Fix Version/s: 3.4.0 Assignee: jiaan.geng Resolution: Fixed > Capitalize sql

[jira] [Resolved] (SPARK-39390) Hide and optimize `viewAcls`/`viewAclsGroups`/`modifyAcls`/`modifyAclsGroups` fron INFO log

[ https://issues.apache.org/jira/browse/SPARK-39390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39390. Fix Version/s: 3.4.0 Assignee: qian Resolution: Fixed > Hide and optimize

[jira] [Created] (SPARK-39312) Use Parquet in predicate for Spark In filter

Huaxin Gao created SPARK-39312: -- Summary: Use Parquet in predicate for Spark In filter Key: SPARK-39312 URL: https://issues.apache.org/jira/browse/SPARK-39312 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37219) support AS OF syntax

[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17537627#comment-17537627 ] Huaxin Gao commented on SPARK-37219: Correct. > support AS OF syntax > > >

[jira] (SPARK-37219) support AS OF syntax

[ https://issues.apache.org/jira/browse/SPARK-37219 ] Huaxin Gao deleted comment on SPARK-37219: was (Author: JIRAUSER284812): h2. Bagaimana Dengan Sistem Keposlot? [Keposlot|https://165.22.216.152/] Menjalankan sistem dengan 1 user id dapat

[jira] (SPARK-37219) support AS OF syntax

[ https://issues.apache.org/jira/browse/SPARK-37219 ] Huaxin Gao deleted comment on SPARK-37219: was (Author: JIRAUSER284812): Situs Resmi Judi Togel Online Terlengkap [Acctoto|https://katie-cassidy.us/]  adalah situs togel online terlengkap di

[jira] [Resolved] (SPARK-39156) Remove ParquetLogRedirector usage from ParquetFileFormat

[ https://issues.apache.org/jira/browse/SPARK-39156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39156. Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed > Remove

[jira] [Resolved] (SPARK-39162) Jdbc dialect should decide which function could be pushed down.

[ https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39162. Fix Version/s: 3.4.0 Assignee: jiaan.geng Resolution: Fixed > Jdbc dialect should

[jira] [Resolved] (SPARK-37259) JDBC read is always going to wrap the query in a select statement

[ https://issues.apache.org/jira/browse/SPARK-37259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37259. Fix Version/s: 3.4.0 Assignee: Peter Toth Resolution: Fixed > JDBC read is always

[jira] [Resolved] (SPARK-39116) Replcace double negation in exists with forall

[ https://issues.apache.org/jira/browse/SPARK-39116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39116. Fix Version/s: 3.4.0 Assignee: Yang Jie (was: Apache Spark) Resolution: Fixed >

[jira] [Updated] (SPARK-39011) V2 Filter to ORC Predicate support

[ https://issues.apache.org/jira/browse/SPARK-39011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-39011: --- Summary: V2 Filter to ORC Predicate support (was: V2 Filter to ORC Filter support) > V2 Filter to

[jira] [Created] (SPARK-39011) V2 Filter to ORC Filter support

Huaxin Gao created SPARK-39011: -- Summary: V2 Filter to ORC Filter support Key: SPARK-39011 URL: https://issues.apache.org/jira/browse/SPARK-39011 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39010) V2 Filter to Parquet Predicate support

Huaxin Gao created SPARK-39010: -- Summary: V2 Filter to Parquet Predicate support Key: SPARK-39010 URL: https://issues.apache.org/jira/browse/SPARK-39010 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-38950) Return Array of Predicate for SupportsPushDownCatalystFilters.pushedFilters

Huaxin Gao created SPARK-38950: -- Summary: Return Array of Predicate for SupportsPushDownCatalystFilters.pushedFilters Key: SPARK-38950 URL: https://issues.apache.org/jira/browse/SPARK-38950 Project:

[jira] [Resolved] (SPARK-38865) Update document of JDBC options for pushDownAggregate and pushDownLimit

[ https://issues.apache.org/jira/browse/SPARK-38865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-38865. Fix Version/s: 3.3.0 3.4.0 Assignee: jiaan.geng Resolution:

[jira] [Created] (SPARK-38825) Add a test to cover parquet notIn filter

Huaxin Gao created SPARK-38825: -- Summary: Add a test to cover parquet notIn filter Key: SPARK-38825 URL: https://issues.apache.org/jira/browse/SPARK-38825 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-38779) Unify the pushed operator checking between FileSource test suite and JDBC test suite

Huaxin Gao created SPARK-38779: -- Summary: Unify the pushed operator checking between FileSource test suite and JDBC test suite Key: SPARK-38779 URL: https://issues.apache.org/jira/browse/SPARK-38779

[jira] [Resolved] (SPARK-38643) Validate input dataset of ml.regression

[ https://issues.apache.org/jira/browse/SPARK-38643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-38643. Assignee: zhengruifeng Resolution: Fixed > Validate input dataset of ml.regression >

[jira] [Resolved] (SPARK-38546) replace deprecated ChiSqSelector with UnivariateFeatureSelector

[ https://issues.apache.org/jira/browse/SPARK-38546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-38546. Resolution: Implemented > replace deprecated ChiSqSelector with UnivariateFeatureSelector >

[jira] [Resolved] (SPARK-38414) Remove redundant SuppressWarnings

[ https://issues.apache.org/jira/browse/SPARK-38414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-38414. Fix Version/s: 3.3.0 Assignee: Yang Jie Resolution: Fixed > Remove redundant

[jira] [Resolved] (SPARK-38269) Clean up redundant type cast

[ https://issues.apache.org/jira/browse/SPARK-38269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-38269. Fix Version/s: 3.3.0 Assignee: Yang Jie Resolution: Fixed > Clean up redundant

[jira] [Resolved] (SPARK-36553) KMeans fails with NegativeArraySizeException for K = 50000 after issue #27758 was introduced

[ https://issues.apache.org/jira/browse/SPARK-36553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-36553. Fix Version/s: 3.1.3 3.3.0 3.2.2 Assignee:

[jira] [Commented] (SPARK-38357) StackOverflowError with OR(data filter, partition filter)

[ https://issues.apache.org/jira/browse/SPARK-38357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499326#comment-17499326 ] Huaxin Gao commented on SPARK-38357: I will submit a PR soon. > StackOverflowError with OR(data

[jira] [Created] (SPARK-38357) StackOverflowError with OR(data filter, partition filter)

Huaxin Gao created SPARK-38357: -- Summary: StackOverflowError with OR(data filter, partition filter) Key: SPARK-38357 URL: https://issues.apache.org/jira/browse/SPARK-38357 Project: Spark Issue

[jira] [Resolved] (SPARK-38100) Remove unused method in `Decimal`

[ https://issues.apache.org/jira/browse/SPARK-38100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-38100. Fix Version/s: 3.2.2 3.3 Resolution: Fixed > Remove unused method in

[jira] [Assigned] (SPARK-38100) Remove unused method in `Decimal`

[ https://issues.apache.org/jira/browse/SPARK-38100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-38100: -- Assignee: Yang Jie > Remove unused method in `Decimal` > - >

[jira] [Assigned] (SPARK-30062) bug with DB2Driver using mode("overwrite") option("truncate",True)

[ https://issues.apache.org/jira/browse/SPARK-30062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-30062: -- Assignee: Ivan Karol > bug with DB2Driver using mode("overwrite") option("truncate",True) >

[jira] [Resolved] (SPARK-30062) bug with DB2Driver using mode("overwrite") option("truncate",True)

[ https://issues.apache.org/jira/browse/SPARK-30062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-30062. Fix Version/s: 3.2.2 3.3 Resolution: Fixed > bug with DB2Driver using

[jira] [Commented] (SPARK-37963) Need to update Partition URI after renaming table in InMemoryCatalog

[ https://issues.apache.org/jira/browse/SPARK-37963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479813#comment-17479813 ] Huaxin Gao commented on SPARK-37963: Changed the fix version to 3.2.2 for now. Will change back if

[jira] [Updated] (SPARK-37963) Need to update Partition URI after renaming table in InMemoryCatalog

[ https://issues.apache.org/jira/browse/SPARK-37963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37963: --- Fix Version/s: 3.2.2 (was: 3.2.1) > Need to update Partition URI after

[jira] [Resolved] (SPARK-37959) Fix the UT of checking norm in KMeans & BiKMeans

[ https://issues.apache.org/jira/browse/SPARK-37959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37959. Fix Version/s: 3.2.1 3.3.0 Assignee: zhengruifeng (was: Apache Spark)

[jira] [Created] (SPARK-37923) Generate partition transforms for BucketSpec inside parser

Huaxin Gao created SPARK-37923: -- Summary: Generate partition transforms for BucketSpec inside parser Key: SPARK-37923 URL: https://issues.apache.org/jira/browse/SPARK-37923 Project: Spark Issue

[jira] [Updated] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37818: --- Fix Version/s: 3.2.1 > Add option for show create table command >

[jira] [Updated] (SPARK-36717) Wrong order of variable initialization may lead to incorrect behavior

[ https://issues.apache.org/jira/browse/SPARK-36717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36717: --- Fix Version/s: (was: 3.2.0) > Wrong order of variable initialization may lead to incorrect

[jira] [Updated] (SPARK-36717) Wrong order of variable initialization may lead to incorrect behavior

[ https://issues.apache.org/jira/browse/SPARK-36717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36717: --- Fix Version/s: 3.2.1 > Wrong order of variable initialization may lead to incorrect behavior >

[jira] [Updated] (SPARK-36979) Add RewriteLateralSubquery rule into nonExcludableRules

[ https://issues.apache.org/jira/browse/SPARK-36979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36979: --- Fix Version/s: 3.2.1 (was: 3.2.0) > Add RewriteLateralSubquery rule into

[jira] [Updated] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-33277: --- Fix Version/s: 3.2.1 > Python/Pandas UDF right after off-heap vectorized reader could cause

[jira] [Updated] (SPARK-36464) Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream for Writing Over 2GB Data

[ https://issues.apache.org/jira/browse/SPARK-36464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36464: --- Fix Version/s: 3.2.0 > Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream

[jira] [Updated] (SPARK-36464) Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream for Writing Over 2GB Data

[ https://issues.apache.org/jira/browse/SPARK-36464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36464: --- Fix Version/s: 3.2.1 (was: 3.2.0) > Fix Underlying Size Variable

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-30789: --- Fix Version/s: (was: 3.2.0) > Support (IGNORE | RESPECT) NULLS for

[jira] [Updated] (SPARK-34399) Add file commit time to metrics and shown in SQL Tab UI

[ https://issues.apache.org/jira/browse/SPARK-34399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-34399: --- Fix Version/s: 3.2.1 (was: 3.2.0) > Add file commit time to metrics and

[jira] [Updated] (SPARK-35714) Bug fix for deadlock during the executor shutdown

[ https://issues.apache.org/jira/browse/SPARK-35714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-35714: --- Fix Version/s: 3.2.1 > Bug fix for deadlock during the executor shutdown >

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-30789: --- Fix Version/s: 3.2.1 > Support (IGNORE | RESPECT) NULLS for

[jira] [Commented] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472183#comment-17472183 ] Huaxin Gao commented on SPARK-37818: [~Gengliang.Wang] version 3.2.2 doesn't exist yet. I will just

[jira] [Updated] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37818: --- Fix Version/s: (was: 3.2.1) > Add option for show create table command >

[jira] [Commented] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472181#comment-17472181 ] Huaxin Gao commented on SPARK-37818: [~Gengliang.Wang] I am drafting the 3.2.1 voting email now. I

[jira] [Updated] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37802: --- Fix Version/s: 3.2.1 (was: 3.2.0) > composite field name like `field name`

[jira] [Updated] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37802: --- Fix Version/s: 3.2.0 > composite field name like `field name` doesn't work with Aggregate push down

[jira] [Resolved] (SPARK-37527) Translate more standard aggregate functions for pushdown

[ https://issues.apache.org/jira/browse/SPARK-37527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37527. Fix Version/s: 3.3.0 Assignee: jiaan.geng Resolution: Fixed > Translate more

[jira] [Assigned] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-37802: -- Assignee: Huaxin Gao > composite field name like `field name` doesn't work with Aggregate

[jira] [Created] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

Huaxin Gao created SPARK-37802: -- Summary: composite field name like `field name` doesn't work with Aggregate push down Key: SPARK-37802 URL: https://issues.apache.org/jira/browse/SPARK-37802 Project:

[jira] [Created] (SPARK-37627) Add sorted column in BucketTransform

Huaxin Gao created SPARK-37627: -- Summary: Add sorted column in BucketTransform Key: SPARK-37627 URL: https://issues.apache.org/jira/browse/SPARK-37627 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-37545) V2 CreateTableAsSelect command should qualify location

[ https://issues.apache.org/jira/browse/SPARK-37545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37545. Fix Version/s: 3.3.0 Assignee: Terry Kim Resolution: Fixed > V2

[jira] [Created] (SPARK-37546) V2 ReplaceTableAsSelect command should qualify location

Huaxin Gao created SPARK-37546: -- Summary: V2 ReplaceTableAsSelect command should qualify location Key: SPARK-37546 URL: https://issues.apache.org/jira/browse/SPARK-37546 Project: Spark Issue

[jira] [Resolved] (SPARK-37330) Migrate ReplaceTableStatement to v2 command

[ https://issues.apache.org/jira/browse/SPARK-37330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37330. Fix Version/s: 3.3.0 Assignee: dch nguyen Resolution: Fixed > Migrate

[jira] [Updated] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified

[ https://issues.apache.org/jira/browse/SPARK-37523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37523: --- Affects Version/s: 3.2.1 > Support optimize skewed partitions in Distribution and Ordering if >

[jira] [Created] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified

Huaxin Gao created SPARK-37523: -- Summary: Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified Key: SPARK-37523 URL: https://issues.apache.org/jira/browse/SPARK-37523

[jira] [Assigned] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command

[ https://issues.apache.org/jira/browse/SPARK-37496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-37496: -- Assignee: Huaxin Gao > Migrate ReplaceTableAsSelectStatement to v2 command >

[jira] [Resolved] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command

[ https://issues.apache.org/jira/browse/SPARK-37496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37496. Resolution: Fixed > Migrate ReplaceTableAsSelectStatement to v2 command >

  1   2   3   4   5   6   7   >