[jira] [Commented] (SPARK-42755) Factor literal value conversion out to connect-common

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699184#comment-17699184 ] Apache Spark commented on SPARK-42755: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42755) Factor literal value conversion out to connect-common

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42755: Assignee: Apache Spark > Factor literal value conversion out to connect-common >

[jira] [Commented] (SPARK-42755) Factor literal value conversion out to connect-common

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699183#comment-17699183 ] Apache Spark commented on SPARK-42755: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42755) Factor literal value conversion out to connect-common

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42755: Assignee: (was: Apache Spark) > Factor literal value conversion out to

[jira] [Updated] (SPARK-42755) Factor literal value conversion out to connect-common

2023-03-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-42755: -- Summary: Factor literal value conversion out to connect-common (was: Move literal value

[jira] [Created] (SPARK-42755) Move literal value conversion to connect-common

2023-03-10 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42755: - Summary: Move literal value conversion to connect-common Key: SPARK-42755 URL: https://issues.apache.org/jira/browse/SPARK-42755 Project: Spark Issue

[jira] [Commented] (SPARK-42721) Add an Interceptor to log RPCs in connect-server

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699153#comment-17699153 ] Apache Spark commented on SPARK-42721: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-42754) Spark 3.4 history server's SQL tab incorrectly groups SQL executions when replaying event logs from Spark 3.3 and earlier

2023-03-10 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-42754: --- Description: In Spark 3.4.0 RC4, the Spark History Server's SQL tab incorrectly groups SQL

[jira] [Created] (SPARK-42754) Spark 3.4 history server's SQL tab incorrectly groups SQL executions when replaying event logs from Spark 3.3 and earlier

2023-03-10 Thread Josh Rosen (Jira)
Josh Rosen created SPARK-42754: -- Summary: Spark 3.4 history server's SQL tab incorrectly groups SQL executions when replaying event logs from Spark 3.3 and earlier Key: SPARK-42754 URL:

[jira] [Updated] (SPARK-42754) Spark 3.4 history server's SQL tab incorrectly groups SQL executions when replaying event logs from Spark 3.3 and earlier

2023-03-10 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-42754: --- Attachment: example.png > Spark 3.4 history server's SQL tab incorrectly groups SQL executions when

[jira] [Commented] (SPARK-42753) ReusedExchange refers to non-existent node

2023-03-10 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699148#comment-17699148 ] ming95 commented on SPARK-42753: [~steven.chen]  Can you provide the reproduction code? >

[jira] [Resolved] (SPARK-42721) Add an Interceptor to log RPCs in connect-server

2023-03-10 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42721. --- Fix Version/s: 3.4.1 (was: 3.5.0) Resolution: Fixed >

[jira] [Assigned] (SPARK-42721) Add an Interceptor to log RPCs in connect-server

2023-03-10 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-42721: - Assignee: Raghu Angadi > Add an Interceptor to log RPCs in connect-server >

[jira] [Commented] (SPARK-42749) CAST(x as int) does not generate error with overflow

2023-03-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699137#comment-17699137 ] Yuming Wang commented on SPARK-42749: - Please enable ansi: {code:sql} spark-sql (default)> set

[jira] [Updated] (SPARK-42753) ReusedExchange refers to non-existent node

2023-03-10 Thread Steven Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Chen updated SPARK-42753: Summary: ReusedExchange refers to non-existent node (was: ReusedExchange refers to non-existen

[jira] [Updated] (SPARK-42753) ReusedExchange refers to non-existen node

2023-03-10 Thread Steven Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Chen updated SPARK-42753: Description: There is an AQE “issue“ where during AQE planning, the Exchange "that's being"

[jira] [Created] (SPARK-42753) ReusedExchange refers to non-existen node

2023-03-10 Thread Steven Chen (Jira)
Steven Chen created SPARK-42753: --- Summary: ReusedExchange refers to non-existen node Key: SPARK-42753 URL: https://issues.apache.org/jira/browse/SPARK-42753 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

2023-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42101: -- Affects Version/s: 3.5.0 (was: 3.4.0) > Wrap InMemoryTableScanExec

[jira] [Resolved] (SPARK-42718) Upgrade rocksdbjni to 7.10.2

2023-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42718. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40337

[jira] [Assigned] (SPARK-42718) Upgrade rocksdbjni to 7.10.2

2023-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42718: - Assignee: Yang Jie > Upgrade rocksdbjni to 7.10.2 > > >

[jira] [Assigned] (SPARK-42752) Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42752: Assignee: Apache Spark > Unprintable IllegalArgumentException with Hive catalog enabled

[jira] [Commented] (SPARK-42752) Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699108#comment-17699108 ] Apache Spark commented on SPARK-42752: -- User 'gerashegalov' has created a pull request for this

[jira] [Assigned] (SPARK-42752) Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42752: Assignee: (was: Apache Spark) > Unprintable IllegalArgumentException with Hive

[jira] [Commented] (SPARK-42752) Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699107#comment-17699107 ] Apache Spark commented on SPARK-42752: -- User 'gerashegalov' has created a pull request for this

[jira] [Updated] (SPARK-42752) Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution

2023-03-10 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-42752: -- Description: Reproduction steps: 1. download a standard "Hadoop Free" build 2. Start pyspark

[jira] [Created] (SPARK-42752) Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution

2023-03-10 Thread Gera Shegalov (Jira)
Gera Shegalov created SPARK-42752: - Summary: Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution Key: SPARK-42752 URL: https://issues.apache.org/jira/browse/SPARK-42752

[jira] [Assigned] (SPARK-41498) Union does not propagate Metadata output

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41498: Assignee: Apache Spark > Union does not propagate Metadata output >

[jira] [Assigned] (SPARK-41498) Union does not propagate Metadata output

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41498: Assignee: (was: Apache Spark) > Union does not propagate Metadata output >

[jira] [Commented] (SPARK-41498) Union does not propagate Metadata output

2023-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699076#comment-17699076 ] Dongjoon Hyun commented on SPARK-41498: --- This is reverted via

[jira] [Updated] (SPARK-41498) Union does not propagate Metadata output

2023-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41498: -- Fix Version/s: (was: 3.4.0) > Union does not propagate Metadata output >

[jira] [Reopened] (SPARK-41498) Union does not propagate Metadata output

2023-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-41498: --- Assignee: (was: Fredrik Klauß) > Union does not propagate Metadata output >

[jira] [Updated] (SPARK-42685) optimize byteToString routines

2023-03-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42685: -- Affects Version/s: 3.5.0 (was: 3.3.2) > optimize byteToString

[jira] [Updated] (SPARK-42751) Pyspark.pandas.series.str.findall can't handle tuples that are returned by regex

2023-03-10 Thread IonK (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] IonK updated SPARK-42751: - Description: When you use the str.findall accessor method on a ps.series and you're passing a regex pattern

[jira] [Updated] (SPARK-42751) Pyspark.pandas.series.str.findall can't handle tuples that are returned by regex

2023-03-10 Thread IonK (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] IonK updated SPARK-42751: - Description: When you use the str.findall accessor method on a ps.series and you're passing a regex pattern

[jira] [Created] (SPARK-42751) Pyspark.pandas.series.str.findall can't handle tuples that are returned by regex

2023-03-10 Thread IonK (Jira)
IonK created SPARK-42751: Summary: Pyspark.pandas.series.str.findall can't handle tuples that are returned by regex Key: SPARK-42751 URL: https://issues.apache.org/jira/browse/SPARK-42751 Project: Spark

[jira] [Updated] (SPARK-42751) Pyspark.pandas.series.str.findall can't handle tuples that are returned by regex

2023-03-10 Thread IonK (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] IonK updated SPARK-42751: - Description: When you use the str.findall accessor method on a ps.series and you're passing a regex pattern

[jira] [Updated] (SPARK-42751) Pyspark.pandas.series.str.findall can't handle tuples that are returned by regex

2023-03-10 Thread IonK (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] IonK updated SPARK-42751: - Description: When you use the str.findall accessor method on a ps.series and you're passing a regex pattern

[jira] [Updated] (SPARK-42743) Support analyze TimestampNTZ columns

2023-03-10 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-42743: --- Fix Version/s: 3.4.0 (was: 3.5.0) > Support analyze TimestampNTZ

[jira] [Commented] (SPARK-42661) CSV Reader - multiline without quoted fields

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699056#comment-17699056 ] Sean R. Owen commented on SPARK-42661: -- I don't know that multi-line makes sense without quoting in

[jira] [Updated] (SPARK-42685) optimize byteToString routines

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42685: - Priority: Minor (was: Major) > optimize byteToString routines > --

[jira] [Resolved] (SPARK-42685) optimize byteToString routines

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42685. -- Fix Version/s: 3.5.0 Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-42036) Kryo ClassCastException getting task result when JDK versions mismatch

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42036. -- Resolution: Not A Problem Mismatching java versions would never be supported per se > Kryo

[jira] [Commented] (SPARK-42198) spark.read fails to read filenames with accented characters

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699044#comment-17699044 ] Sean R. Owen commented on SPARK-42198: -- You would not add /dbfs on Databricks in this case, that's

[jira] [Resolved] (SPARK-42127) Spark 3.3.0, Error with java.io.IOException: Mkdirs failed to create file

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42127. -- Resolution: Not A Problem No detail here, not obvious that this isn't just a permissions

[jira] [Commented] (SPARK-42425) spark-hadoop-cloud is not provided in the default Spark distribution

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699042#comment-17699042 ] Sean R. Owen commented on SPARK-42425: -- The docs don't say it's part of the Spark distro. in fact

[jira] [Resolved] (SPARK-42425) spark-hadoop-cloud is not provided in the default Spark distribution

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42425. -- Resolution: Not A Problem > spark-hadoop-cloud is not provided in the default Spark

[jira] [Commented] (SPARK-42479) Log4j2 doesn't works with Spark 3.3.0

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699041#comment-17699041 ] Sean R. Owen commented on SPARK-42479: -- This is because you're pointing at some local path not

[jira] [Resolved] (SPARK-42479) Log4j2 doesn't works with Spark 3.3.0

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42479. -- Resolution: Not A Problem > Log4j2 doesn't works with Spark 3.3.0 >

[jira] [Resolved] (SPARK-42607) [MESOS] OMP_NUM_THREADS not set to number of executor cores by default

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42607. -- Resolution: Not A Problem > [MESOS] OMP_NUM_THREADS not set to number of executor cores by

[jira] [Commented] (SPARK-42607) [MESOS] OMP_NUM_THREADS not set to number of executor cores by default

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699040#comment-17699040 ] Sean R. Owen commented on SPARK-42607: -- I don't think we're touching Mesos at this point - all but

[jira] [Created] (SPARK-42750) Support INSERT INTO by name

2023-03-10 Thread Jose Torres (Jira)
Jose Torres created SPARK-42750: --- Summary: Support INSERT INTO by name Key: SPARK-42750 URL: https://issues.apache.org/jira/browse/SPARK-42750 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699039#comment-17699039 ] Sean R. Owen commented on SPARK-42627: -- Not enough info here. What type is not supported? > Spark:

[jira] [Commented] (SPARK-42714) Sparksql temporary file conflict

2023-03-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699038#comment-17699038 ] Sean R. Owen commented on SPARK-42714: -- Not really enough info here. How does it happen? >

[jira] [Updated] (SPARK-42749) CAST(x as int) does not generate error with overflow

2023-03-10 Thread Tjomme Vergauwen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tjomme Vergauwen updated SPARK-42749: - Attachment: Spark-42749.PNG > CAST(x as int) does not generate error with overflow >

[jira] [Created] (SPARK-42749) CAST(x as int) does not generate error with overflow

2023-03-10 Thread Tjomme Vergauwen (Jira)
Tjomme Vergauwen created SPARK-42749: Summary: CAST(x as int) does not generate error with overflow Key: SPARK-42749 URL: https://issues.apache.org/jira/browse/SPARK-42749 Project: Spark

[jira] [Commented] (SPARK-41498) Union does not propagate Metadata output

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699010#comment-17699010 ] Apache Spark commented on SPARK-41498: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42620) Add `inclusive` parameter for (DataFrame|Series).between_time

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42620: Assignee: (was: Apache Spark) > Add `inclusive` parameter for

[jira] [Assigned] (SPARK-42620) Add `inclusive` parameter for (DataFrame|Series).between_time

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42620: Assignee: Apache Spark > Add `inclusive` parameter for (DataFrame|Series).between_time >

[jira] [Commented] (SPARK-42620) Add `inclusive` parameter for (DataFrame|Series).between_time

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698999#comment-17698999 ] Apache Spark commented on SPARK-42620: -- User 'dzhigimont' has created a pull request for this

[jira] [Commented] (SPARK-42398) refine default column value framework

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698982#comment-17698982 ] Apache Spark commented on SPARK-42398: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-42748) Server-side Artifact Management

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698952#comment-17698952 ] Apache Spark commented on SPARK-42748: -- User 'vicennial' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42748) Server-side Artifact Management

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42748: Assignee: Apache Spark > Server-side Artifact Management >

[jira] [Assigned] (SPARK-42748) Server-side Artifact Management

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42748: Assignee: (was: Apache Spark) > Server-side Artifact Management >

[jira] [Created] (SPARK-42748) Server-side Artifact Management

2023-03-10 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42748: Summary: Server-side Artifact Management Key: SPARK-42748 URL: https://issues.apache.org/jira/browse/SPARK-42748 Project: Spark

[jira] [Commented] (SPARK-42747) Fix incorrect internal status of LoR and AFT

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698943#comment-17698943 ] Apache Spark commented on SPARK-42747: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42747) Fix incorrect internal status of LoR and AFT

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42747: Assignee: Apache Spark > Fix incorrect internal status of LoR and AFT >

[jira] [Assigned] (SPARK-42747) Fix incorrect internal status of LoR and AFT

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42747: Assignee: (was: Apache Spark) > Fix incorrect internal status of LoR and AFT >

[jira] (SPARK-42691) Implement Dataset.semanticHash

2023-03-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42691 ] jiaan.geng deleted comment on SPARK-42691: was (Author: beliefer): I will take a look! > Implement Dataset.semanticHash > -- > > Key: SPARK-42691

[jira] [Assigned] (SPARK-42691) Implement Dataset.semanticHash

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42691: Assignee: (was: Apache Spark) > Implement Dataset.semanticHash >

[jira] [Assigned] (SPARK-42691) Implement Dataset.semanticHash

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42691: Assignee: Apache Spark > Implement Dataset.semanticHash > --

[jira] [Commented] (SPARK-42691) Implement Dataset.semanticHash

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698935#comment-17698935 ] Apache Spark commented on SPARK-42691: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

2023-03-10 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-42745: --- Description: After SPARK-40086 / SPARK-42049 the following, simple subselect expression containing

[jira] [Assigned] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

2023-03-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42745: --- Assignee: Peter Toth > Improved AliasAwareOutputExpression works with DSv2 >

[jira] [Resolved] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

2023-03-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42745. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40364

[jira] [Created] (SPARK-42747) Fix incorrect internal status of LoR and AFT

2023-03-10 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42747: - Summary: Fix incorrect internal status of LoR and AFT Key: SPARK-42747 URL: https://issues.apache.org/jira/browse/SPARK-42747 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42743) Support analyze TimestampNTZ columns

2023-03-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42743. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40362

[jira] [Assigned] (SPARK-42743) Support analyze TimestampNTZ columns

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42743: Assignee: Gengliang Wang (was: Apache Spark) > Support analyze TimestampNTZ columns >

[jira] [Assigned] (SPARK-42743) Support analyze TimestampNTZ columns

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42743: Assignee: Apache Spark (was: Gengliang Wang) > Support analyze TimestampNTZ columns >

[jira] [Commented] (SPARK-42743) Support analyze TimestampNTZ columns

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698876#comment-17698876 ] Apache Spark commented on SPARK-42743: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-42691) Implement Dataset.semanticHash

2023-03-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698872#comment-17698872 ] jiaan.geng commented on SPARK-42691: I will take a look! > Implement Dataset.semanticHash >

[jira] [Created] (SPARK-42746) Add the LISTAGG() aggregate function

2023-03-10 Thread Max Gekk (Jira)
Max Gekk created SPARK-42746: Summary: Add the LISTAGG() aggregate function Key: SPARK-42746 URL: https://issues.apache.org/jira/browse/SPARK-42746 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-42746) Add the LISTAGG() aggregate function

2023-03-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-42746: - Description: {{listagg()}} is a common and useful aggregation function to concatenate string values in

[jira] [Updated] (SPARK-42737) Shuffle files lost with graceful decommission fallback storage enabled

2023-03-10 Thread Yeachan Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeachan Park updated SPARK-42737: - Description: During testing of graceful decommissioning, the driver logs indicate that shuffle

[jira] [Updated] (SPARK-42737) Shuffle files lost with graceful decommission fallback storage enabled

2023-03-10 Thread Yeachan Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeachan Park updated SPARK-42737: - Description: During testing of graceful decommissioning, the driver logs indicate that shuffle

[jira] [Assigned] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42745: Assignee: (was: Apache Spark) > Improved AliasAwareOutputExpression works with DSv2

[jira] [Commented] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698851#comment-17698851 ] Apache Spark commented on SPARK-42745: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

2023-03-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42745: Assignee: Apache Spark > Improved AliasAwareOutputExpression works with DSv2 >

[jira] [Commented] (SPARK-42744) delete uploaded file when job finish

2023-03-10 Thread Hu Ziqian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698833#comment-17698833 ] Hu Ziqian commented on SPARK-42744: --- add pr https://github.com/apache/spark/pull/40363 > delete

[jira] [Updated] (SPARK-42745) Improved AliasAwareOutputExpression works with DSv2

2023-03-10 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-42745: --- Summary: Improved AliasAwareOutputExpression works with DSv2 (was: Fix NPE after recent

[jira] [Created] (SPARK-42745) Fix NPE after recent AliasAwareOutputExpression changes

2023-03-10 Thread Peter Toth (Jira)
Peter Toth created SPARK-42745: -- Summary: Fix NPE after recent AliasAwareOutputExpression changes Key: SPARK-42745 URL: https://issues.apache.org/jira/browse/SPARK-42745 Project: Spark Issue

[jira] [Created] (SPARK-42744) delete uploaded file when job finish

2023-03-10 Thread Hu Ziqian (Jira)
Hu Ziqian created SPARK-42744: - Summary: delete uploaded file when job finish Key: SPARK-42744 URL: https://issues.apache.org/jira/browse/SPARK-42744 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42743) Support analyze TimestampNTZ columns

2023-03-10 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-42743: -- Summary: Support analyze TimestampNTZ columns Key: SPARK-42743 URL: https://issues.apache.org/jira/browse/SPARK-42743 Project: Spark Issue Type: