[jira] [Assigned] (SPARK-47260) Assign classes to Row to JSON errors

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47260: -- Assignee: Apache Spark > Assign classes to Row to JSON err

[jira] [Assigned] (SPARK-47260) Assign classes to Row to JSON errors

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47260: -- Assignee: Apache Spark > Assign classes to Row to JSON err

[jira] [Assigned] (SPARK-47260) Assign classes to Row to JSON errors

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47260: -- Assignee: (was: Apache Spark) > Assign classes to Row to JSON err

[jira] [Assigned] (SPARK-47260) Assign classes to Row to JSON errors

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47260: -- Assignee: (was: Apache Spark) > Assign classes to Row to JSON err

[jira] [Assigned] (SPARK-47260) Assign classes to Row to JSON errors

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47260: -- Assignee: Apache Spark > Assign classes to Row to JSON err

[jira] [Reopened] (SPARK-48415) TypeName support parameterized datatypes

2024-05-30 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reopened SPARK-48415: --- > TypeName support parameterized dataty

[jira] [Updated] (SPARK-48471) Improve documentation and usage guide for history server

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48471: --- Labels: pull-request-available (was: ) > Improve documentation and usage guide for hist

[jira] [Updated] (SPARK-48280) Add Expression Walker for Testing

2024-05-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48280: --- Labels: pull-request-available (was: ) > Add Expression Walker for Test

[jira] [Created] (SPARK-48472) Expression Walker Test

2024-05-30 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-48472: - Summary: Expression Walker Test Key: SPARK-48472 URL: https://issues.apache.org/jira/browse/SPARK-48472 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48471) Improve documentation and usage guide for history server

2024-05-30 Thread Kent Yao (Jira)
Kent Yao created SPARK-48471: Summary: Improve documentation and usage guide for history server Key: SPARK-48471 URL: https://issues.apache.org/jira/browse/SPARK-48471 Project: Spark Issue Type

[jira] [Created] (SPARK-48470) Rename listState functions for single and list type appends

2024-05-29 Thread Anish Shrigondekar (Jira)
Anish Shrigondekar created SPARK-48470: -- Summary: Rename listState functions for single and list type appends Key: SPARK-48470 URL: https://issues.apache.org/jira/browse/SPARK-48470 Project

[jira] [Updated] (SPARK-45959) SPIP: Abusing DataSet.withColumn can cause huge tree with severe perf degradation

2024-05-29 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-45959: - Priority: Major (was: Minor) > SPIP: Abusing DataSet.withColumn can cause huge tree with severe p

[jira] [Resolved] (SPARK-48464) Refactor SQLConfSuite and StatisticsSuite

2024-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48464. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46796 [https

[jira] [Updated] (SPARK-48468) Add LogicalQueryStage interface in catalyst

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48468: --- Labels: pull-request-available (was: ) > Add LogicalQueryStage interface in catal

[jira] [Created] (SPARK-48468) Add LogicalQueryStage interface in catalyst

2024-05-29 Thread Ziqi Liu (Jira)
Ziqi Liu created SPARK-48468: Summary: Add LogicalQueryStage interface in catalyst Key: SPARK-48468 URL: https://issues.apache.org/jira/browse/SPARK-48468 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48454) Directly use the parent dataframe class

2024-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48454. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46785 [https

[jira] [Assigned] (SPARK-48454) Directly use the parent dataframe class

2024-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48454: Assignee: Ruifeng Zheng > Directly use the parent dataframe cl

[jira] [Updated] (SPARK-48467) Upgrade Maven to 3.9.7

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48467: --- Labels: pull-request-available (was: ) > Upgrade Maven to 3.

[jira] [Resolved] (SPARK-48442) Add parenthesis to awaitTermination call

2024-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48442. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46779 [https

[jira] [Created] (SPARK-48467) Upgrade Maven to 3.9.7

2024-05-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48467: --- Summary: Upgrade Maven to 3.9.7 Key: SPARK-48467 URL: https://issues.apache.org/jira/browse/SPARK-48467 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48465) Avoid no-op empty relation propagation in AQE

2024-05-29 Thread Ziqi Liu (Jira)
Ziqi Liu created SPARK-48465: Summary: Avoid no-op empty relation propagation in AQE Key: SPARK-48465 URL: https://issues.apache.org/jira/browse/SPARK-48465 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-48431) Do not forward predicates on collated columns to file readers

2024-05-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48431. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46760 [https

[jira] [Updated] (SPARK-48446) Update SS Doc of dropDuplicatesWithinWatermark to use the right syntax

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48446: --- Labels: easyfix pull-request-available (was: easyfix) > Update SS

[jira] [Commented] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-29 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850486#comment-17850486 ] Zheng Shao commented on SPARK-48380: A second look at the stacktrace shows that the current issue

[jira] [Updated] (SPARK-48464) Refactor SQLConfSuite and StatisticsSuite

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48464: --- Labels: pull-request-available (was: ) > Refactor SQLConfSuite and StatisticsSu

[jira] [Created] (SPARK-48464) Refactor SQLConfSuite and StatisticsSuite

2024-05-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-48464: Summary: Refactor SQLConfSuite and StatisticsSuite Key: SPARK-48464 URL: https://issues.apache.org/jira/browse/SPARK-48464 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-48462) Refactor HiveQuerySuite.scala and HiveTableScanSuite

2024-05-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48462. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46792 [https

[jira] [Commented] (SPARK-44970) Spark History File Uploads Can Fail on S3

2024-05-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850475#comment-17850475 ] Steve Loughran commented on SPARK-44970: correct. file is only saved on close(). The incomplete

[jira] [Updated] (SPARK-48423) Unable to write MLPipeline to blob storage using .option attribute

2024-05-29 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chhavi Bansal updated SPARK-48423: -- Description: I am trying to write mllib pipeline with a series of stages set in it to azure

[jira] [Updated] (SPARK-48423) Unable to write MLPipeline to blob storage using .option attribute

2024-05-29 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chhavi Bansal updated SPARK-48423: -- Description: I am trying to write mllib pipeline with a series of stages set in it to azure

[jira] [Created] (SPARK-48463) MLLib function unable to handle tested data

2024-05-29 Thread Chhavi Bansal (Jira)
Chhavi Bansal created SPARK-48463: - Summary: MLLib function unable to handle tested data Key: SPARK-48463 URL: https://issues.apache.org/jira/browse/SPARK-48463 Project: Spark Issue Type

[jira] [Updated] (SPARK-48463) MLLib function unable to handle nested data

2024-05-29 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chhavi Bansal updated SPARK-48463: -- Summary: MLLib function unable to handle nested data (was: MLLib function unable to handle

[jira] [Updated] (SPARK-48461) Replace NullPointerExceptions with proper error classes in AssertNotNull expression

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48461: --- Labels: pull-request-available (was: ) > Replace NullPointerExceptions with proper er

[jira] [Assigned] (SPARK-48281) Alter string search logic for: instr, substring_index (UTF8_BINARY_LCASE)

2024-05-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48281: --- Assignee: Uroš Bojanić > Alter string search logic for: instr, substring_in

[jira] [Resolved] (SPARK-48281) Alter string search logic for: instr, substring_index (UTF8_BINARY_LCASE)

2024-05-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48281. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46589 [https

[jira] [Updated] (SPARK-48462) Refactor HiveQuerySuite.scala and HiveTableScanSuite

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48462: --- Labels: pull-request-available (was: ) > Refactor HiveQuerySuite.sc

[jira] [Created] (SPARK-48462) Refactor HiveQuerySuite.scala and HiveTableScanSuite

2024-05-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-48462: Summary: Refactor HiveQuerySuite.scala and HiveTableScanSuite Key: SPARK-48462 URL: https://issues.apache.org/jira/browse/SPARK-48462 Project: Spark Issue Type: Sub

[jira] [Resolved] (SPARK-48444) Refactor SQLQuerySuite

2024-05-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48444. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46778 [https

[jira] [Updated] (SPARK-48447) Check state store provider class before invoking the constructor

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48447: --- Labels: pull-request-available (was: ) > Check state store provider class before invok

[jira] [Created] (SPARK-48461) Replace NullPointerExceptions with proper error classes in AssertNotNull expression

2024-05-29 Thread Daniel (Jira)
Daniel created SPARK-48461: -- Summary: Replace NullPointerExceptions with proper error classes in AssertNotNull expression Key: SPARK-48461 URL: https://issues.apache.org/jira/browse/SPARK-48461 Project

[jira] [Updated] (SPARK-48460) Spark ORC writer generates incorrect meta information(min, max)

2024-05-29 Thread Volodymyr T (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Volodymyr T updated SPARK-48460: Description: We found that Hive cannot concatenate some ORC files generated by Spark 3.2.1

[jira] [Created] (SPARK-48460) Spark ORC writer generates incorrect meta information(mix, max)

2024-05-29 Thread Volodymyr T (Jira)
Volodymyr T created SPARK-48460: --- Summary: Spark ORC writer generates incorrect meta information(mix, max) Key: SPARK-48460 URL: https://issues.apache.org/jira/browse/SPARK-48460 Project: Spark

[jira] [Updated] (SPARK-48460) Spark ORC writer generates incorrect meta information(min, max)

2024-05-29 Thread Volodymyr T (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Volodymyr T updated SPARK-48460: Summary: Spark ORC writer generates incorrect meta information(min, max) (was: Spark ORC writer

[jira] [Commented] (SPARK-48361) Correctness: CSV corrupt record filter with aggregate ignored

2024-05-29 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850431#comment-17850431 ] Ted Chester Jenks commented on SPARK-48361: --- Yeah, it all makes sense, but a little less than

[jira] [Updated] (SPARK-48423) Unable to write MLPipeline to blob storage using .option attribute

2024-05-29 Thread Chhavi Bansal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chhavi Bansal updated SPARK-48423: -- Priority: Blocker (was: Major) > Unable to write MLPipeline to blob storage using .opt

[jira] [Reopened] (SPARK-48322) Drop internal metadata in `DataFrame.schema`

2024-05-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reopened SPARK-48322: --- > Drop internal metadata in `DataFrame.sch

[jira] [Assigned] (SPARK-48322) Drop internal metadata in `DataFrame.schema`

2024-05-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-48322: - Assignee: (was: Ruifeng Zheng) > Drop internal metadata in `DataFrame.sch

[jira] [Reopened] (SPARK-42965) metadata mismatch for StructField when running some tests.

2024-05-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reopened SPARK-42965: --- Assignee: (was: Ruifeng Zheng) > metadata mismatch for StructField when running s

[jira] [Commented] (SPARK-48402) Virtualenv section of "Python Package Management" does not work on Windows

2024-05-29 Thread Wolff Bock von Wuelfingen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850347#comment-17850347 ] Wolff Bock von Wuelfingen commented on SPARK-48402: --- Additional notes: #environment

[jira] [Updated] (SPARK-48459) Implement DataFrameQueryContext in Spark Connect

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48459: --- Labels: pull-request-available (was: ) > Implement DataFrameQueryContext in Spark Conn

[jira] [Created] (SPARK-48459) Implement DataFrameQueryContext in Spark Connect

2024-05-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48459: Summary: Implement DataFrameQueryContext in Spark Connect Key: SPARK-48459 URL: https://issues.apache.org/jira/browse/SPARK-48459 Project: Spark Issue Type

[jira] [Created] (SPARK-48458) Dynamic partition override mode might be ignored in certain scenarios causing data loss

2024-05-29 Thread Artem Kupchinskiy (Jira)
Artem Kupchinskiy created SPARK-48458: - Summary: Dynamic partition override mode might be ignored in certain scenarios causing data loss Key: SPARK-48458 URL: https://issues.apache.org/jira/browse/SPARK-48458

[jira] [Commented] (SPARK-47415) Levenshtein (all collations)

2024-05-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850313#comment-17850313 ] Uroš Bojanić commented on SPARK-47415: -- [~nikolamand-db] [~nebojsa-db] For more context

[jira] [Created] (SPARK-48457) Testing and operational readiness

2024-05-29 Thread David Milicevic (Jira)
David Milicevic created SPARK-48457: --- Summary: Testing and operational readiness Key: SPARK-48457 URL: https://issues.apache.org/jira/browse/SPARK-48457 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48456) Performance benchmark

2024-05-29 Thread David Milicevic (Jira)
David Milicevic created SPARK-48456: --- Summary: Performance benchmark Key: SPARK-48456 URL: https://issues.apache.org/jira/browse/SPARK-48456 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48455) Public documentation

2024-05-29 Thread David Milicevic (Jira)
David Milicevic created SPARK-48455: --- Summary: Public documentation Key: SPARK-48455 URL: https://issues.apache.org/jira/browse/SPARK-48455 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-48454) Directly use the parent dataframe class

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48454: -- Assignee: (was: Apache Spark) > Directly use the parent dataframe cl

[jira] [Assigned] (SPARK-48454) Directly use the parent dataframe class

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48454: -- Assignee: Apache Spark > Directly use the parent dataframe cl

[jira] [Assigned] (SPARK-48454) Directly use the parent dataframe class

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48454: -- Assignee: Apache Spark > Directly use the parent dataframe cl

[jira] [Assigned] (SPARK-48416) Support related nested WITH expression

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48416: -- Assignee: (was: Apache Spark) > Support related nested WITH express

[jira] [Assigned] (SPARK-48416) Support related nested WITH expression

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48416: -- Assignee: Apache Spark > Support related nested WITH express

[jira] [Updated] (SPARK-48454) Directly use the parent dataframe class

2024-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48454: --- Labels: pull-request-available (was: ) > Directly use the parent dataframe cl

[jira] [Commented] (SPARK-48377) Multiple results API - sqlScript()

2024-05-29 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850298#comment-17850298 ] David Milicevic commented on SPARK-48377: - I took it on myself to write an API proposal

[jira] [Created] (SPARK-48453) Support for PRINT/TRACE statement

2024-05-29 Thread David Milicevic (Jira)
David Milicevic created SPARK-48453: --- Summary: Support for PRINT/TRACE statement Key: SPARK-48453 URL: https://issues.apache.org/jira/browse/SPARK-48453 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48377) Multiple results API - sqlScript()

2024-05-29 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48377: Description: For now: * Write an API proposal ** The API itself should be fine, but we

[jira] [Commented] (SPARK-48452) Spark Connect investigation

2024-05-29 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850296#comment-17850296 ] David Milicevic commented on SPARK-48452: - [~milan.dankovic] is working on this. > Sp

[jira] [Created] (SPARK-48452) Spark Connect investigation

2024-05-29 Thread David Milicevic (Jira)
David Milicevic created SPARK-48452: --- Summary: Spark Connect investigation Key: SPARK-48452 URL: https://issues.apache.org/jira/browse/SPARK-48452 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-48426) Make a documentation for SQL Operators with clear precedence defined

2024-05-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48426. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46757 [https

[jira] [Assigned] (SPARK-48426) Make a documentation for SQL Operators with clear precedence defined

2024-05-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48426: Assignee: Kent Yao > Make a documentation for SQL Operators with clear precedence defi

[jira] [Updated] (SPARK-48450) Support Jdbc datasource custom data partitioning

2024-05-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-48450: -- Description: "partitionColumn, lowerBound, upperBound" is not an efficient table partition

[jira] [Updated] (SPARK-48450) Support Jdbc datasource custom data partitioning

2024-05-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-48450: -- Description: "partitionColumn, lowerBound, upperBound" is not an efficient table partition

[jira] [Updated] (SPARK-48451) Fail to Create Table with VOID columns in ORC Format with CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48451: --- Description: When I executed Spark SQL: *CREATE TABLE t1 STORED AS ORC AS SELECT NULL AS id, 'abc

[jira] [Updated] (SPARK-48392) Load `spark-defaults.conf` when passing configurations to `spark-submit` through `--properties-file`

2024-05-28 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-48392: - Summary: Load `spark-defaults.conf` when passing configurations to `spark-submit` through `--properties

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL to create Hive table with default file

[jira] [Resolved] (SPARK-48392) (Optionally) Load `spark-defaults.conf` when passing configurations to `spark-submit` through `--properties-file`

2024-05-28 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-48392. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46709 [https

[jira] [Assigned] (SPARK-48392) (Optionally) Load `spark-defaults.conf` when passing configurations to `spark-submit` through `--properties-file`

2024-05-28 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-48392: Assignee: Chao Sun > (Optionally) Load `spark-defaults.conf` when passing configurati

[jira] [Resolved] (SPARK-48000) Hash join support for strings with collation (StringType only)

2024-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48000. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46599 [https

[jira] [Assigned] (SPARK-48000) Hash join support for strings with collation (StringType only)

2024-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48000: --- Assignee: Uroš Bojanić > Hash join support for strings with collation (StringType o

[jira] [Updated] (SPARK-48451) Fail to Create Table with VOID columns in ORC Format with CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48451: --- Description: When I executed Spark SQL: *CREATE TABLE t1 STORED AS ORC AS SELECT NULL AS id, 'abc

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL to create Hive table with default file

[jira] [Created] (SPARK-48451) Fail to Create Table with VOID columns in ORC Format with CTAS

2024-05-28 Thread dohongdayi (Jira)
dohongdayi created SPARK-48451: -- Summary: Fail to Create Table with VOID columns in ORC Format with CTAS Key: SPARK-48451 URL: https://issues.apache.org/jira/browse/SPARK-48451 Project: Spark

[jira] [Commented] (SPARK-47259) Assign classes to interval errors

2024-05-28 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850238#comment-17850238 ] Wei Guo commented on SPARK-47259: - Update `_LEGACY_ERROR_TEMP_32[08-14]` to `_LEGACY_ERROR_TEMP_32[09-14

[jira] [Updated] (SPARK-47259) Assign classes to interval errors

2024-05-28 Thread Wei Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-47259: Description: Choose a proper name for the error class *_LEGACY_ERROR_TEMP_32[09-14]* defined in {*}core

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL to create Hive table with default file

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL to create Hive table with default file

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL to create Hive table with default file

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL to create Hive table with default file

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL to create Hive table with default file

[jira] [Updated] (SPARK-48449) Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name`

2024-05-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48449: --- Labels: pull-request-available (was: ) > Using `getPropertyInfo` instead of `reflect

[jira] [Created] (SPARK-48449) Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name`

2024-05-28 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48449: --- Summary: Using `getPropertyInfo` instead of `reflection` to obtain `JAAS application name` Key: SPARK-48449 URL: https://issues.apache.org/jira/browse/SPARK-48449

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL with default hive file format 'text

[jira] [Updated] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dohongdayi updated SPARK-48448: --- Description: After I executed the following Spark SQL with default hive file format 'text

[jira] [Resolved] (SPARK-48445) Don't inline UDFs with non-cheap children in CollapseProject

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48445. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46780 [https

[jira] [Created] (SPARK-48448) Mismatched Row Count for Tables in Text Format Created by CTAS

2024-05-28 Thread dohongdayi (Jira)
dohongdayi created SPARK-48448: -- Summary: Mismatched Row Count for Tables in Text Format Created by CTAS Key: SPARK-48448 URL: https://issues.apache.org/jira/browse/SPARK-48448 Project: Spark

[jira] [Assigned] (SPARK-48445) Don't inline UDFs with non-cheap children in CollapseProject

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48445: Assignee: Kelvin Jiang > Don't inline UDFs with non-cheap children in CollapseProj

[jira] [Resolved] (SPARK-48436) Use `c.m.c.j.Driver` instead of `c.m.j.Driver` in `MySQLNamespaceSuite`

2024-05-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48436. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46773 [https

[jira] [Commented] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850230#comment-17850230 ] Hyukjin Kwon commented on SPARK-23015: -- Fixed in https://github.com/apache/spark/pull/43706

[jira] [Reopened] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-23015: -- > spark-submit fails when submitting several jobs in paral

[jira] [Resolved] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23015. -- Fix Version/s: 4.0.0 Resolution: Fixed > spark-submit fails when submitting seve

[jira] [Assigned] (SPARK-42965) metadata mismatch for StructField when running some tests.

2024-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42965: Assignee: Ruifeng Zheng > metadata mismatch for StructField when running some te

<    2   3   4   5   6   7   8   9   10   11   >