[jira] [Resolved] (SPARK-40395) Provide query context in AnalysisException

2023-11-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40395. Resolution: Implemented > Provide query context in AnalysisException >

[jira] [Commented] (SPARK-40395) Provide query context in AnalysisException

2023-11-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789768#comment-17789768 ] Gengliang Wang commented on SPARK-40395: Resolved in

[jira] [Resolved] (SPARK-35161) Error-handling SQL functions

2023-11-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35161. Resolution: Done > Error-handling SQL functions > > >

[jira] [Assigned] (SPARK-35161) Error-handling SQL functions

2023-11-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35161: -- Assignee: Gengliang Wang > Error-handling SQL functions >

[jira] [Updated] (SPARK-46105) df.emptyDataFrame shows 1 if we repartition

2023-11-25 Thread dharani_sugumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dharani_sugumar updated SPARK-46105: Attachment: Screenshot 2023-11-26 at 11.54.58 AM.png > df.emptyDataFrame shows 1 if we

[jira] [Updated] (SPARK-46105) df.emptyDataFrame shows 1 if we repartition(1) in Spark 3.3.x and above

2023-11-25 Thread dharani_sugumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dharani_sugumar updated SPARK-46105: Summary: df.emptyDataFrame shows 1 if we repartition(1) in Spark 3.3.x and above (was:

[jira] [Created] (SPARK-46105) df.emptyDataFrame shows 1 if we repartition

2023-11-25 Thread dharani_sugumar (Jira)
dharani_sugumar created SPARK-46105: --- Summary: df.emptyDataFrame shows 1 if we repartition Key: SPARK-46105 URL: https://issues.apache.org/jira/browse/SPARK-46105 Project: Spark Issue

[jira] [Updated] (SPARK-46090) Support plan fragment level SQL configs in AQE

2023-11-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46090: --- Labels: pull-request-available (was: ) > Support plan fragment level SQL configs in AQE >

[jira] [Updated] (SPARK-46090) Support plan fragment level SQL configs in AQE

2023-11-25 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-46090: -- Summary: Support plan fragment level SQL configs in AQE (was: Support plan fragment level SQL

[jira] [Updated] (SPARK-46090) Support plan fragment level SQL configs

2023-11-25 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-46090: -- Summary: Support plan fragment level SQL configs (was: Support stage level SQL configs) > Support

[jira] [Updated] (SPARK-46090) Support plan fragment level SQL configs

2023-11-25 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-46090: -- Description: AQE executes query plan stage by stage, so there is a chance to support plan fragment

[jira] [Updated] (SPARK-46104) NPE when broadcast join include null key

2023-11-25 Thread lrz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lrz updated SPARK-46104: Attachment: 1.jpg > NPE when broadcast join include null key > > >

[jira] [Updated] (SPARK-46104) NPE when broadcast join include null key

2023-11-25 Thread lrz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lrz updated SPARK-46104: Description: missing initialize for UnsafeProjection at UnsafeHashedRelation, which lead to a npe exception when

[jira] [Created] (SPARK-46104) NPE when broadcast join include null key

2023-11-25 Thread lrz (Jira)
lrz created SPARK-46104: --- Summary: NPE when broadcast join include null key Key: SPARK-46104 URL: https://issues.apache.org/jira/browse/SPARK-46104 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-44850) Heartbeat (sparkconnect scala)

2023-11-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44850: --- Labels: pull-request-available (was: ) > Heartbeat (sparkconnect scala) >

[jira] [Updated] (SPARK-44209) Expose amount of shuffle data available on the node

2023-11-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44209: --- Labels: pull-request-available (was: ) > Expose amount of shuffle data available on the

[jira] [Resolved] (SPARK-33275) ANSI mode: runtime errors instead of returning null on invalid inputs

2023-11-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-33275. Resolution: Done > ANSI mode: runtime errors instead of returning null on invalid inputs

[jira] [Assigned] (SPARK-33275) ANSI mode: runtime errors instead of returning null on invalid inputs

2023-11-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-33275: -- Assignee: Apache Spark > ANSI mode: runtime errors instead of returning null on

[jira] [Resolved] (SPARK-46100) Replace (string|array).size with (string|array).length in module core

2023-11-25 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-46100. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44011

[jira] [Updated] (SPARK-46101) Replace (string|array).size with (string|array).length in module SQL

2023-11-25 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-46101: - Priority: Minor (was: Major) Summary: Replace (string|array).size with

[jira] [Updated] (SPARK-46100) Replace (string|array).size with (string|array).length in module core

2023-11-25 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-46100: - Summary: Replace (string|array).size with (string|array).length in module core (was: Fix these

[jira] [Updated] (SPARK-46100) Replace (string|array).size with (string|array).length in module core

2023-11-25 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-46100: - Priority: Minor (was: Major) > Replace (string|array).size with (string|array).length in

[jira] [Updated] (SPARK-46102) Prune keys or values from Generate if it is a map type

2023-11-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-46102: Summary: Prune keys or values from Generate if it is a map type (was: Prune keys or values from

[jira] [Created] (SPARK-46102) Prune keys or values from Generate if it is a map type.

2023-11-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-46102: --- Summary: Prune keys or values from Generate if it is a map type. Key: SPARK-46102 URL: https://issues.apache.org/jira/browse/SPARK-46102 Project: Spark Issue

[jira] [Updated] (SPARK-45715) QueryPlanningTracker::measurePhase minor refactor

2023-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45715: -- Fix Version/s: (was: 3.4.2) > QueryPlanningTracker::measurePhase minor refactor >

[jira] [Updated] (SPARK-45715) QueryPlanningTracker::measurePhase minor refactor

2023-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45715: -- Affects Version/s: 4.0.0 (was: 3.4.1) >

[jira] [Updated] (SPARK-46072) Missing .jars when applying code to spark-connect

2023-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46072: -- Fix Version/s: (was: 3.4.2) (was: 3.5.1) > Missing .jars when

[jira] [Updated] (SPARK-46072) Missing .jars when applying code to spark-connect

2023-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46072: -- Target Version/s: (was: 3.5.0) > Missing .jars when applying code to spark-connect >

[jira] [Created] (SPARK-46101) Fix these issue in module sql

2023-11-25 Thread Jiaan Geng (Jira)
Jiaan Geng created SPARK-46101: -- Summary: Fix these issue in module sql Key: SPARK-46101 URL: https://issues.apache.org/jira/browse/SPARK-46101 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46100) Fix these issue in module core

2023-11-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46100: --- Labels: pull-request-available (was: ) > Fix these issue in module core >

[jira] [Created] (SPARK-46100) Fix these issue in module core

2023-11-25 Thread Jiaan Geng (Jira)
Jiaan Geng created SPARK-46100: -- Summary: Fix these issue in module core Key: SPARK-46100 URL: https://issues.apache.org/jira/browse/SPARK-46100 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46098) Reduce stack depth by replace (string|array).size with (string|array).length

2023-11-25 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-46098: --- Description: There are a lot of (string|array).size called. In fact, the size calls the underlying

[jira] [Updated] (SPARK-46098) Reduce stack depth by replace (string|array).size with (string|array).length

2023-11-25 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-46098: --- Description: There are a lot of (string|array).size called. In fact, the size calls the underlying

[jira] [Updated] (SPARK-46098) Reduce stack depth by replace (string|array).size with (string|array).length

2023-11-25 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-46098: --- Description: There are a lot of # Replace .size with .length on arrays and strings # Replace .size