[jira] [Updated] (SPARK-48421) SPJ: Add documentation

2024-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48421: --- Labels: pull-request-available (was: ) > SPJ: Add documentation > -- >

[jira] [Updated] (SPARK-48420) Upgrade netty to `4.1.110.Final`

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48420: --- Labels: pull-request-available (was: ) > Upgrade netty to `4.1.110.Final` >

[jira] [Updated] (SPARK-48419) Foldable propagation replace foldable column should use origin column

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48419: --- Labels: pull-request-available (was: ) > Foldable propagation replace foldable column

[jira] [Updated] (SPARK-47041) PushDownUtils uses FileScanBuilder instead of SupportsPushDownCatalystFilters trait

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47041: --- Labels: pull-request-available (was: ) > PushDownUtils uses FileScanBuilder instead of

[jira] [Updated] (SPARK-48416) Support related nested WITH expression

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48416: --- Labels: pull-request-available (was: ) > Support related nested WITH expression >

[jira] [Updated] (SPARK-48411) Add E2E test for DropDuplicateWithinWatermark

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48411: --- Labels: pull-request-available (was: ) > Add E2E test for DropDuplicateWithinWatermark >

[jira] [Updated] (SPARK-48415) TypeName support parameterized datatypes

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48415: --- Labels: pull-request-available (was: ) > TypeName support parameterized datatypes >

[jira] [Updated] (SPARK-48414) Fix breaking change in python's `fromJson`

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48414: --- Labels: pull-request-available (was: ) > Fix breaking change in python's `fromJson` >

[jira] [Updated] (SPARK-48409) Upgrade MySQL & Postgres & mariadb docker image version

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48409: --- Labels: pull-request-available (was: ) > Upgrade MySQL & Postgres & mariadb docker image

[jira] [Updated] (SPARK-48413) ALTER COLUMN with collation

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48413: --- Labels: pull-request-available (was: ) > ALTER COLUMN with collation >

[jira] [Updated] (SPARK-48412) Refactor data type json parse

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48412: --- Labels: pull-request-available (was: ) > Refactor data type json parse >

[jira] [Updated] (SPARK-48410) Fix InitCap expression

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48410: --- Labels: pull-request-available (was: ) > Fix InitCap expression > -- >

[jira] [Updated] (SPARK-47257) Assign error classes to ALTER COLUMN errors

2024-05-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47257: --- Labels: pull-request-available starter (was: starter) > Assign error classes to ALTER

[jira] [Updated] (SPARK-48408) Simplify `date_format` & `from_unixtime`

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48408: --- Labels: pull-request-available (was: ) > Simplify `date_format` & `from_unixtime` >

[jira] [Updated] (SPARK-48407) Teradata: Document Type Conversion rules between Spark SQL and teradata

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48407: --- Labels: pull-request-available (was: ) > Teradata: Document Type Conversion rules between

[jira] [Updated] (SPARK-48406) Upgrade commons-cli to 1.8.0

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48406: --- Labels: pull-request-available (was: ) > Upgrade commons-cli to 1.8.0 >

[jira] [Updated] (SPARK-48283) Implement modified Lowercase operation for UTF8_BINARY_LCASE

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48283: --- Labels: pull-request-available (was: ) > Implement modified Lowercase operation for

[jira] [Updated] (SPARK-48405) Upgrade `commons-compress` to 1.26.2

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48405: --- Labels: pull-request-available (was: ) > Upgrade `commons-compress` to 1.26.2 >

[jira] [Updated] (SPARK-48318) Hash join support for strings with collation (complex types)

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48318: --- Labels: pull-request-available (was: ) > Hash join support for strings with collation

[jira] [Updated] (SPARK-41049) Nondeterministic expressions have unstable values if they are children of CodegenFallback expressions

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41049: --- Labels: correctness pull-request-available (was: correctness) > Nondeterministic

[jira] [Updated] (SPARK-48400) Promote `PrometheusServlet` to `DeveloperApi`

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48400: --- Labels: pull-request-available (was: ) > Promote `PrometheusServlet` to `DeveloperApi` >

[jira] [Updated] (SPARK-48399) Teradata: ByteType wrongly mapping to teradata byte(binary) type

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48399: --- Labels: pull-request-available (was: ) > Teradata: ByteType wrongly mapping to teradata

[jira] [Updated] (SPARK-48382) Add controller / reconciler module to operator

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48382: --- Labels: pull-request-available (was: ) > Add controller / reconciler module to operator >

[jira] [Updated] (SPARK-48397) Add data write time metric to FileFormatDataWriter/BasicWriteJobStatsTracker

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48397: --- Labels: pull-request-available (was: ) > Add data write time metric to

[jira] [Updated] (SPARK-48396) Support configuring limit control for SQL to use maximum cores

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48396: --- Labels: pull-request-available (was: ) > Support configuring limit control for SQL to use

[jira] [Updated] (SPARK-48391) use addAll instead of add function in TaskMetrics to accelerate

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48391: --- Labels: pull-request-available (was: ) > use addAll instead of add function in

[jira] [Updated] (SPARK-48394) Cleanup mapIdToMapIndex on mapoutput unregister

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48394: --- Labels: pull-request-available (was: ) > Cleanup mapIdToMapIndex on mapoutput unregister >

[jira] [Updated] (SPARK-48393) Move a group of constants to `pyspark.util`

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48393: --- Labels: pull-request-available (was: ) > Move a group of constants to `pyspark.util` >

[jira] [Updated] (SPARK-48392) (Optionally) Load `spark-defaults.conf` when passing configurations to `spark-submit` through `--properties-file`

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48392: --- Labels: pull-request-available (was: ) > (Optionally) Load `spark-defaults.conf` when

[jira] [Updated] (SPARK-48386) Replace JVM assert with JUnit Assert in tests

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48386: --- Labels: pull-request-available (was: ) > Replace JVM assert with JUnit Assert in tests >

[jira] [Updated] (SPARK-43043) Improve the performance of MapOutputTracker.updateMapOutput

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43043: --- Labels: pull-request-available (was: ) > Improve the performance of

[jira] [Updated] (SPARK-48364) Type casting for AbstractMapType

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48364: --- Labels: pull-request-available (was: ) > Type casting for AbstractMapType >

[jira] [Updated] (SPARK-48389) Remove obsolete workflow cancel_duplicate_workflow_runs

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48389: --- Labels: pull-request-available (was: ) > Remove obsolete workflow

[jira] [Assigned] (SPARK-48379) Cancel build during a PR when a new commit is pushed

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48379: -- Assignee: (was: Apache Spark) > Cancel build during a PR when a new commit is

[jira] [Assigned] (SPARK-48379) Cancel build during a PR when a new commit is pushed

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48379: -- Assignee: Apache Spark > Cancel build during a PR when a new commit is pushed >

[jira] [Assigned] (SPARK-48370) Checkpoint and localCheckpoint in Scala Spark Connect client

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48370: -- Assignee: Apache Spark > Checkpoint and localCheckpoint in Scala Spark Connect

[jira] [Assigned] (SPARK-48370) Checkpoint and localCheckpoint in Scala Spark Connect client

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48370: -- Assignee: (was: Apache Spark) > Checkpoint and localCheckpoint in Scala Spark

[jira] [Updated] (SPARK-48385) Migrate the jdbc driver of mariadb from 2.x to 3.x

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48385: --- Labels: pull-request-available (was: ) > Migrate the jdbc driver of mariadb from 2.x to

[jira] [Updated] (SPARK-48387) Postgres: Map TimestampType to TIMESTAMP WITH TIME ZONE

2024-05-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48387: --- Labels: pull-request-available (was: ) > Postgres: Map TimestampType to TIMESTAMP WITH

[jira] [Updated] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48292: --- Labels: pull-request-available (was: ) > Revert [SPARK-39195][SQL] Spark

[jira] [Updated] (SPARK-48384) Exclude `io.netty:netty-tcnative-boringssl-static` from `zookeeper`

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48384: --- Labels: pull-request-available (was: ) > Exclude

[jira] [Updated] (SPARK-48383) In KafkaOffsetReader, partition mismatch should not be an assertion

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48383: --- Labels: pull-request-available (was: ) > In KafkaOffsetReader, partition mismatch should

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48380: --- Labels: pull-request-available (was: ) > AutoBatchedPickler caused Unsafe allocate to fail

[jira] [Updated] (SPARK-48381) Update `YuniKorn` docs with v1.5.1

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48381: --- Labels: pull-request-available (was: ) > Update `YuniKorn` docs with v1.5.1 >

[jira] [Updated] (SPARK-48379) Cancel build during a PR when a new commit is pushed

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48379: --- Labels: pull-request-available (was: ) > Cancel build during a PR when a new commit is

[jira] [Updated] (SPARK-48374) Support additional PyArrow Table column types

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48374: --- Labels: pull-request-available (was: ) > Support additional PyArrow Table column types >

[jira] [Updated] (SPARK-48373) Allow schema parameter of createDataFrame() to be length-1 list or tuple of StructType

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48373: --- Labels: pull-request-available (was: ) > Allow schema parameter of createDataFrame() to be

[jira] [Updated] (SPARK-48372) Implement `StructType.treeString`

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48372: --- Labels: pull-request-available (was: ) > Implement `StructType.treeString` >

[jira] [Updated] (SPARK-48370) Checkpoint and localCheckpoint in Scala Spark Connect client

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48370: --- Labels: pull-request-available (was: ) > Checkpoint and localCheckpoint in Scala Spark

[jira] [Updated] (SPARK-48282) Alter string search logic for: replace, find_in_set (UTF8_BINARY_LCASE)

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48282: --- Labels: pull-request-available (was: ) > Alter string search logic for: replace,

[jira] [Assigned] (SPARK-48369) Add function timestamp_add

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48369: -- Assignee: Apache Spark > Add function timestamp_add > -- > >

[jira] [Assigned] (SPARK-48359) Built-in functions for Zstd compression and decompression

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48359: -- Assignee: (was: Apache Spark) > Built-in functions for Zstd compression and

[jira] [Updated] (SPARK-48369) Add function timestamp_add

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48369: --- Labels: pull-request-available (was: ) > Add function timestamp_add >

[jira] [Assigned] (SPARK-48342) Parser support

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: Apache Spark > Parser support > -- > > Key:

[jira] [Assigned] (SPARK-48342) Parser support

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: (was: Apache Spark) > Parser support > -- > >

[jira] [Assigned] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48365: -- Assignee: (was: Apache Spark) > DB2: Document Mapping Spark SQL Data Types to

[jira] [Assigned] (SPARK-48354) Added function support and testing for filter push down in JDBC connectors

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48354: -- Assignee: (was: Apache Spark) > Added function support and testing for filter

[jira] [Assigned] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48365: -- Assignee: Apache Spark > DB2: Document Mapping Spark SQL Data Types to DB2 >

[jira] [Assigned] (SPARK-48354) Added function support and testing for filter push down in JDBC connectors

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48354: -- Assignee: Apache Spark > Added function support and testing for filter push down in

[jira] [Assigned] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47008: -- Assignee: Apache Spark > Spark to support S3 Express One Zone Storage >

[jira] [Assigned] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47008: -- Assignee: (was: Apache Spark) > Spark to support S3 Express One Zone Storage >

[jira] [Updated] (SPARK-48367) Fix lint-scala for scalafmt to detect properly

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48367: --- Labels: pull-request-available (was: ) > Fix lint-scala for scalafmt to detect properly >

[jira] [Updated] (SPARK-48341) Allow Spark Connect plugins to use QueryTest in their tests

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48341: --- Labels: pull-request-available (was: ) > Allow Spark Connect plugins to use QueryTest in

[jira] [Updated] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47008: --- Labels: pull-request-available (was: ) > Spark to support S3 Express One Zone Storage >

[jira] [Updated] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48365: --- Labels: pull-request-available (was: ) > DB2: Document Mapping Spark SQL Data Types to DB2

[jira] [Updated] (SPARK-48366) Simplify statements related to `filter`

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48366: --- Labels: pull-request-available (was: ) > Simplify statements related to `filter` >

[jira] [Updated] (SPARK-48363) Cleanup some redundant codes in `from_xml`

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48363: --- Labels: pull-request-available (was: ) > Cleanup some redundant codes in `from_xml` >

[jira] [Updated] (SPARK-48359) Built-in functions for Zstd compression and decompression

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48359: --- Labels: pull-request-available (was: ) > Built-in functions for Zstd compression and

[jira] [Updated] (SPARK-48342) Parser support

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48342: --- Labels: pull-request-available (was: ) > Parser support > -- > >

[jira] [Updated] (SPARK-48360) Simplify conditionals with predicate branches

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48360: --- Labels: pull-request-available (was: ) > Simplify conditionals with predicate branches >

[jira] [Updated] (SPARK-48354) Added function support and testing for filter push down in JDBC connectors

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48354: --- Labels: pull-request-available (was: ) > Added function support and testing for filter

[jira] [Updated] (SPARK-48351) JDBC Connectors - Add cast suite

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48351: --- Labels: pull-request-available (was: ) > JDBC Connectors - Add cast suite >

[jira] [Updated] (SPARK-48352) set max file counter through spark conf

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48352: --- Labels: pull-request-available (was: ) > set max file counter through spark conf >

[jira] [Updated] (SPARK-48340) Support TimestampNTZ infer schema miss prefer_timestamp_ntz

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48340: --- Labels: pull-request-available (was: ) > Support TimestampNTZ infer schema miss

[jira] [Updated] (SPARK-48339) Revert converting collated strings to regular strings when writing to hive metastore

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48339: --- Labels: pull-request-available (was: ) > Revert converting collated strings to regular

[jira] [Assigned] (SPARK-48307) InlineCTE should keep not-inlined relations in the original WithCTE node

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48307: -- Assignee: Apache Spark > InlineCTE should keep not-inlined relations in the original

[jira] [Assigned] (SPARK-48258) Implement DataFrame.checkpoint and DataFrame.localCheckpoint

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48258: -- Assignee: (was: Apache Spark) > Implement DataFrame.checkpoint and

[jira] [Updated] (SPARK-48335) Make `_parse_datatype_string` compatible with Spark Connect

2024-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48335: --- Labels: pull-request-available (was: ) > Make `_parse_datatype_string` compatible with

[jira] [Updated] (SPARK-48333) Test `test_sorting_functions_with_column` with same `Column`

2024-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48333: --- Labels: pull-request-available (was: ) > Test `test_sorting_functions_with_column` with

[jira] [Updated] (SPARK-48332) Upgrade `jdbc` related test dependencies

2024-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48332: --- Labels: pull-request-available (was: ) > Upgrade `jdbc` related test dependencies >

[jira] [Updated] (SPARK-48330) Fix the python streaming data source timeout issue for large trigger interval

2024-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48330: --- Labels: pull-request-available (was: ) > Fix the python streaming data source timeout

[jira] [Updated] (SPARK-48329) Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to true

2024-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48329: --- Labels: pull-request-available (was: ) > Default

[jira] [Updated] (SPARK-48328) Upgrade `Arrow` to 16.1.0

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48328: --- Labels: pull-request-available (was: ) > Upgrade `Arrow` to 16.1.0 >

[jira] [Updated] (SPARK-48325) Always specify messages in ExecutorRunner.killProcess

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48325: --- Labels: pull-request-available (was: ) > Always specify messages in

[jira] [Updated] (SPARK-48324) Codegen Support for `hll_sketch_estimate` and `hll_union`

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48324: --- Labels: pull-request-available (was: ) > Codegen Support for `hll_sketch_estimate` and

[jira] [Updated] (SPARK-48323) DB2: Map BooleanType to Boolean instead of Char(1)

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48323: --- Labels: pull-request-available (was: ) > DB2: Map BooleanType to Boolean instead of

[jira] [Assigned] (SPARK-48159) Datetime expressions (all collations)

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48159: -- Assignee: (was: Apache Spark) > Datetime expressions (all collations) >

[jira] [Assigned] (SPARK-48159) Datetime expressions (all collations)

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48159: -- Assignee: Apache Spark > Datetime expressions (all collations) >

[jira] [Updated] (SPARK-48322) Drop internal metadata in `DataFrame.schema`

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48322: --- Labels: pull-request-available (was: ) > Drop internal metadata in `DataFrame.schema` >

[jira] [Assigned] (SPARK-47972) Restrict CAST expression for collations

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47972: -- Assignee: (was: Apache Spark) > Restrict CAST expression for collations >

[jira] [Assigned] (SPARK-47972) Restrict CAST expression for collations

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47972: -- Assignee: Apache Spark > Restrict CAST expression for collations >

[jira] [Updated] (SPARK-48321) Avoid using deprecated methods in dsl

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48321: --- Labels: pull-request-available (was: ) > Avoid using deprecated methods in dsl >

[jira] [Updated] (SPARK-48320) Add external third-party ecosystem access guide to the doc

2024-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48320: --- Labels: pull-request-available (was: ) > Add external third-party ecosystem access guide

[jira] [Updated] (SPARK-48319) Test `assert_true` and `raise_error` with the same error class as Spark Classic

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48319: --- Labels: pull-request-available (was: ) > Test `assert_true` and `raise_error` with the

[jira] [Updated] (SPARK-48317) Enable test_udtf_with_analyze_using_archive and test_udtf_with_analyze_using_file

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48317: --- Labels: pull-request-available (was: ) > Enable test_udtf_with_analyze_using_archive and

[jira] [Updated] (SPARK-48316) Enable SparkFrameMethodsParityTests.test_coalesce and test_repartition

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48316: --- Labels: pull-request-available (was: ) > Enable SparkFrameMethodsParityTests.test_coalesce

[jira] [Updated] (SPARK-48314) FileStreamSource shouldn't double cache files for availableNow

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48314: --- Labels: pull-request-available (was: ) > FileStreamSource shouldn't double cache files for

[jira] [Updated] (SPARK-43815) Add to_varchar alias for to_char SQL function

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43815: --- Labels: pull-request-available (was: ) > Add to_varchar alias for to_char SQL function >

[jira] [Updated] (SPARK-48294) Make nestedTypeMissingElementTypeError case insensitive

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48294: --- Labels: pull-request-available (was: ) > Make nestedTypeMissingElementTypeError case

[jira] [Updated] (SPARK-48309) Stop am retry, in situations where some errors and retries may not be successful

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48309: --- Labels: pull-request-available (was: ) > Stop am retry, in situations where some errors

  1   2   3   4   5   6   7   8   9   10   >