[jira] [Created] (SPARK-52183) Update `SparkSQLRepl` example to show 10k rows by default

2025-05-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52183: - Summary: Update `SparkSQLRepl` example to show 10k rows by default Key: SPARK-52183 URL: https://issues.apache.org/jira/browse/SPARK-52183 Project: Spark I

[jira] [Updated] (SPARK-52183) Update `SparkSQLRepl` example to show up to 10k rows

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52183: -- Summary: Update `SparkSQLRepl` example to show up to 10k rows (was: Update `SparkSQLRepl` exa

[jira] [Assigned] (SPARK-52182) Support `withWatermark` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52182: - Assignee: Dongjoon Hyun > Support `withWatermark` for `DataFrame` > ---

[jira] [Created] (SPARK-52182) Support `withWatermark` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52182: - Summary: Support `withWatermark` for `DataFrame` Key: SPARK-52182 URL: https://issues.apache.org/jira/browse/SPARK-52182 Project: Spark Issue Type: Sub-tas

[jira] [Assigned] (SPARK-52175) Make a scheduled build for releasing Apache Spark (dry-run)

2025-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52175: Assignee: Hyukjin Kwon > Make a scheduled build for releasing Apache Spark (dry-run) > --

[jira] [Resolved] (SPARK-52175) Make a scheduled build for releasing Apache Spark (dry-run)

2025-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52175. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50884 [https://gi

[jira] [Updated] (SPARK-52178) Make release scripts to respect SKIP_TAG and ANSWER when already set

2025-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52178: - Summary: Make release scripts to respect SKIP_TAG and ANSWER when already set (was: Make a sche

[jira] [Updated] (SPARK-52175) Make a scheduled build for releasing Apache Spark (dry-run)

2025-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52175: - Summary: Make a scheduled build for releasing Apache Spark (dry-run) (was: Make release scripts

[jira] [Created] (SPARK-52181) Increase variant size limit to 128MiB

2025-05-15 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-52181: -- Summary: Increase variant size limit to 128MiB Key: SPARK-52181 URL: https://issues.apache.org/jira/browse/SPARK-52181 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-52130) Refine error message, and hide internal spark config

2025-05-15 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-52130. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50894 [https://github

[jira] [Assigned] (SPARK-52130) Refine error message, and hide internal spark config

2025-05-15 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-52130: -- Assignee: Weichen Xu > Refine error message, and hide internal spark config > ---

[jira] [Created] (SPARK-52180) Create artifacts for output and log files in dry-run build

2025-05-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52180: Summary: Create artifacts for output and log files in dry-run build Key: SPARK-52180 URL: https://issues.apache.org/jira/browse/SPARK-52180 Project: Spark Is

[jira] [Created] (SPARK-52179) GitHub workflow for releasing the official Apache Spark

2025-05-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52179: Summary: GitHub workflow for releasing the official Apache Spark Key: SPARK-52179 URL: https://issues.apache.org/jira/browse/SPARK-52179 Project: Spark Issu

[jira] [Assigned] (SPARK-52178) Make a scheduled build for releasing Apache Spark (dry-run)

2025-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52178: Assignee: Hyukjin Kwon > Make a scheduled build for releasing Apache Spark (dry-run) > --

[jira] [Resolved] (SPARK-52178) Make a scheduled build for releasing Apache Spark (dry-run)

2025-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52178. -- Fix Version/s: 3.5.6 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-52175) Make release scripts to respect SKIP_TAG and ANSWER when already set

2025-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52175: - Parent: SPARK-52176 Issue Type: Sub-task (was: Improvement) > Make release scripts to r

[jira] [Created] (SPARK-52178) Make a scheduled build for releasing Apache Spark (dry-run)

2025-05-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52178: Summary: Make a scheduled build for releasing Apache Spark (dry-run) Key: SPARK-52178 URL: https://issues.apache.org/jira/browse/SPARK-52178 Project: Spark

[jira] [Deleted] (SPARK-52177) Make a scheduled build for releasing Apache Spark (dry-run)

2025-05-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-52177: - > Make a scheduled build for releasing Apache Spark (dry-run) > ---

[jira] [Created] (SPARK-52177) Make a scheduled build for releasing Apache Spark (dry-run)

2025-05-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52177: Summary: Make a scheduled build for releasing Apache Spark (dry-run) Key: SPARK-52177 URL: https://issues.apache.org/jira/browse/SPARK-52177 Project: Spark

[jira] [Created] (SPARK-52176) Release Apache Spark via GitHub Actions

2025-05-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52176: Summary: Release Apache Spark via GitHub Actions Key: SPARK-52176 URL: https://issues.apache.org/jira/browse/SPARK-52176 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-52144) Refactor memory profiling tests with shared assertion utility

2025-05-15 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-52144. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50896 [https://

[jira] [Assigned] (SPARK-52144) Refactor memory profiling tests with shared assertion utility

2025-05-15 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-52144: - Assignee: Xinrong Meng > Refactor memory profiling tests with shared assertion utility

[jira] [Created] (SPARK-52175) Make release scripts to respect SKIP_TAG and ANSWER when already set

2025-05-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52175: Summary: Make release scripts to respect SKIP_TAG and ANSWER when already set Key: SPARK-52175 URL: https://issues.apache.org/jira/browse/SPARK-52175 Project: Spark

[jira] [Resolved] (SPARK-52170) Add test to verify divide-by-zero behavior in Pandas on Spark

2025-05-15 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-52170. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50907 [https://

[jira] [Resolved] (SPARK-52172) Add `checkpoint` and `localCheckpoint` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52172. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Created] (SPARK-52174) Enable `spark.checkpoint.compress` by default

2025-05-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52174: - Summary: Enable `spark.checkpoint.compress` by default Key: SPARK-52174 URL: https://issues.apache.org/jira/browse/SPARK-52174 Project: Spark Issue Type: S

[jira] [Created] (SPARK-52173) Fix OwnerReference Patching for Spark Application Driver Resources

2025-05-15 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-52173: -- Summary: Fix OwnerReference Patching for Spark Application Driver Resources Key: SPARK-52173 URL: https://issues.apache.org/jira/browse/SPARK-52173 Project: Spark

[jira] [Resolved] (SPARK-52145) Add tests for mapInPandas schema mismatch

2025-05-15 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52145. -- Assignee: Xinrong Meng Resolution: Resolved Resolved by https://github.com/apache/spark/

[jira] [Created] (SPARK-52172) Add `checkpoint` and `localCheckpoint` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52172: - Summary: Add `checkpoint` and `localCheckpoint` for `DataFrame` Key: SPARK-52172 URL: https://issues.apache.org/jira/browse/SPARK-52172 Project: Spark Issu

[jira] [Created] (SPARK-52171) Add StateDataSource implementation for state format v3 for join

2025-05-15 Thread Livia Zhu (Jira)
Livia Zhu created SPARK-52171: - Summary: Add StateDataSource implementation for state format v3 for join Key: SPARK-52171 URL: https://issues.apache.org/jira/browse/SPARK-52171 Project: Spark Is

[jira] [Created] (SPARK-52170) Add test to verify divide-by-zero behavior in Pandas on Spark

2025-05-15 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52170: Summary: Add test to verify divide-by-zero behavior in Pandas on Spark Key: SPARK-52170 URL: https://issues.apache.org/jira/browse/SPARK-52170 Project: Spark

[jira] [Created] (SPARK-52169) Enable divide-by-zero for Pandas on Spark with ANSI enabled

2025-05-15 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52169: Summary: Enable divide-by-zero for Pandas on Spark with ANSI enabled Key: SPARK-52169 URL: https://issues.apache.org/jira/browse/SPARK-52169 Project: Spark

[jira] [Assigned] (SPARK-52168) Support `to` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52168: - Assignee: Dongjoon Hyun > Support `to` for `DataFrame` > >

[jira] [Resolved] (SPARK-52168) Support `to` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52168. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Resolved] (SPARK-52167) Support `hint` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52167. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Created] (SPARK-52168) Support `to` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52168: - Summary: Support `to` for `DataFrame` Key: SPARK-52168 URL: https://issues.apache.org/jira/browse/SPARK-52168 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-52167) Support `hint` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52167: - Assignee: Dongjoon Hyun > Support `hint` for `DataFrame` >

[jira] [Created] (SPARK-52167) Support `hint` for `DataFrame`

2025-05-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52167: - Summary: Support `hint` for `DataFrame` Key: SPARK-52167 URL: https://issues.apache.org/jira/browse/SPARK-52167 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-52164) Support `MergeIntoWriter`

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52164: - Assignee: Dongjoon Hyun > Support `MergeIntoWriter` > - > >

[jira] [Resolved] (SPARK-52164) Support `MergeIntoWriter`

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52164. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Created] (SPARK-52166) [SDP] Add support for PipelineEvents

2025-05-15 Thread Jon Mio (Jira)
Jon Mio created SPARK-52166: --- Summary: [SDP] Add support for PipelineEvents Key: SPARK-52166 URL: https://issues.apache.org/jira/browse/SPARK-52166 Project: Spark Issue Type: Sub-task Com

[jira] [Updated] (SPARK-52165) [SDP] Setup build scaffolding for the pipelines project

2025-05-15 Thread Jon Mio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Mio updated SPARK-52165: Summary: [SDP] Setup build scaffolding for the pipelines project (was: Setup build scaffolding for the pi

[jira] [Created] (SPARK-52165) Setup build scaffolding for the pipelines project

2025-05-15 Thread Jon Mio (Jira)
Jon Mio created SPARK-52165: --- Summary: Setup build scaffolding for the pipelines project Key: SPARK-52165 URL: https://issues.apache.org/jira/browse/SPARK-52165 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52164) Support `MergeIntoWriter`

2025-05-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52164: - Summary: Support `MergeIntoWriter` Key: SPARK-52164 URL: https://issues.apache.org/jira/browse/SPARK-52164 Project: Spark Issue Type: Sub-task Co

[jira] [Updated] (SPARK-52163) Spark3.4 LogicalRDD stats estimation may throw bigInt.reportOverflow

2025-05-15 Thread Igor Railean (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Railean updated SPARK-52163: - Description: Due to updates in LogicalRDD stats calculation [SPARK-39748[SQL][SS] Include the o

[jira] [Created] (SPARK-52163) Spark3.4 LogicalRDD stats estimation may throw bigInt.reportOverflow

2025-05-15 Thread Igor Railean (Jira)
Igor Railean created SPARK-52163: Summary: Spark3.4 LogicalRDD stats estimation may throw bigInt.reportOverflow Key: SPARK-52163 URL: https://issues.apache.org/jira/browse/SPARK-52163 Project: Spark

[jira] [Resolved] (SPARK-52162) Add `DELETE/UPDATE` and partitioned table tests

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52162. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Created] (SPARK-52162) Add `DELETE/UPDATE` and partitioned table tests

2025-05-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52162: - Summary: Add `DELETE/UPDATE` and partitioned table tests Key: SPARK-52162 URL: https://issues.apache.org/jira/browse/SPARK-52162 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-52161) Add `home`, `sources`, `maintainers`, 'keywords` metadata to `Chart.yaml`

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52161. --- Fix Version/s: kubernetes-operator-0.2.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-52161) Add `home`, `sources`, `maintainers`, 'keywords` metadata to `Chart.yaml`

2025-05-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52161: - Summary: Add `home`, `sources`, `maintainers`, 'keywords` metadata to `Chart.yaml` Key: SPARK-52161 URL: https://issues.apache.org/jira/browse/SPARK-52161 Project:

[jira] [Resolved] (SPARK-52100) Enable overriding the recursion level limit in syntax

2025-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52100. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50890 [https://gith

[jira] [Assigned] (SPARK-52100) Enable overriding the recursion level limit in syntax

2025-05-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52100: --- Assignee: Pavle Martinović > Enable overriding the recursion level limit in syntax > --

[jira] [Resolved] (SPARK-52096) Reclassify kafka source offset assertion error

2025-05-15 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-52096. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50866 [https://gi

[jira] [Assigned] (SPARK-52096) Reclassify kafka source offset assertion error

2025-05-15 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-52096: Assignee: Yuchen Liu > Reclassify kafka source offset assertion error > -

[jira] [Resolved] (SPARK-52150) Add `Iceberg` integration test `GitHub Action` job

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52150. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Resolved] (SPARK-52155) Update `.asf.yaml` to show Spark Connect Swift website

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52155. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Resolved] (SPARK-52154) Update `.asf.yaml` to show Spark K8s operator website

2025-05-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52154. --- Fix Version/s: kubernetes-operator-0.2.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-52160) Dynamic pruning not being used with broadcast hash join

2025-05-15 Thread John Smith (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Smith updated SPARK-52160: --- Description: We have a hive partitioned dataset, partitioned on year, month, day. When doing a broa

[jira] [Created] (SPARK-52160) Dynamic pruning not being used with broadcast hash join

2025-05-15 Thread John Smith (Jira)
John Smith created SPARK-52160: -- Summary: Dynamic pruning not being used with broadcast hash join Key: SPARK-52160 URL: https://issues.apache.org/jira/browse/SPARK-52160 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2025-05-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-49872: Assignee: Steven Aerts > Spark History UI -- StreamConstraintsException: String length (20054016)

[jira] [Reopened] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2025-05-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reopened SPARK-49872: -- > Spark History UI -- StreamConstraintsException: String length (20054016) > exceeds the maximum length (

[jira] [Updated] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2025-05-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-49872: - Fix Version/s: 4.1.0 > Spark History UI -- StreamConstraintsException: String length (20054016) > excee

[jira] [Comment Edited] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2025-05-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17951713#comment-17951713 ] Yang Jie edited comment on SPARK-49872 at 5/15/25 12:01 PM:

[jira] [Commented] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2025-05-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17951713#comment-17951713 ] Yang Jie commented on SPARK-49872: -- Resolved by https://github.com/apache/spark/pull/49

[jira] [Updated] (SPARK-52159) [JDBC] Improve error handling in table exists check

2025-05-15 Thread Milan Stefanovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Stefanovic updated SPARK-52159: - Summary: [JDBC] Improve error handling in table exists check (was: Improve error handli

[jira] [Created] (SPARK-52159) Improve error handling in table exists check

2025-05-15 Thread Milan Stefanovic (Jira)
Milan Stefanovic created SPARK-52159: Summary: Improve error handling in table exists check Key: SPARK-52159 URL: https://issues.apache.org/jira/browse/SPARK-52159 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2025-05-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-49872. -- Resolution: Fixed > Spark History UI -- StreamConstraintsException: String length (20054016) > exceed

[jira] [Resolved] (SPARK-47150) String length (...) exceeds the maximum length (20000000)

2025-05-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47150. -- Resolution: Duplicate > String length (...) exceeds the maximum length (2000) > --

[jira] [Created] (SPARK-52158) NERF errors thrown in SparkConnectPlanner

2025-05-15 Thread Yihong He (Jira)
Yihong He created SPARK-52158: - Summary: NERF errors thrown in SparkConnectPlanner Key: SPARK-52158 URL: https://issues.apache.org/jira/browse/SPARK-52158 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-52158) NERF errors thrown in SparkConnectPlanner

2025-05-15 Thread Yihong He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-52158: -- Description: The errors thrown in the SparkConnectPlanner currently do not really use the New Error Fr

[jira] [Updated] (SPARK-52157) Use earlier computed name for OuterReference in single-pass resolver

2025-05-15 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-52157: Description: In the following query we would have min(outer(t2.t2a)) as a name for min(t2a

[jira] [Updated] (SPARK-52157) Use earlier computed name for OuterReference in single-pass resolver

2025-05-15 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-52157: Summary: Use earlier computed name for OuterReference in single-pass resolver (was: Remov

[jira] [Updated] (SPARK-52157) Remove `outer` part out of OuterReference name in single-pass

2025-05-15 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-52157: Description: In the following query we would have min(outer(t2.t2a)) as a name for min(t2a

[jira] [Created] (SPARK-52157) Remove `outer` part out of OuterReference name in single-pass

2025-05-15 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-52157: --- Summary: Remove `outer` part out of OuterReference name in single-pass Key: SPARK-52157 URL: https://issues.apache.org/jira/browse/SPARK-52157 Project: Spark

[jira] [Created] (SPARK-52156) Put legacy CREATE TEMPORARY TABLE ... USING provider under the flag

2025-05-15 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-52156: - Summary: Put legacy CREATE TEMPORARY TABLE ... USING provider under the flag Key: SPARK-52156 URL: https://issues.apache.org/jira/browse/SPARK-52156 Project

[jira] [Updated] (SPARK-51289) Internal error on RETURNS TABLE

2025-05-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51289: - Fix Version/s: 4.0.0 > Internal error on RETURNS TABLE > --- > >

[jira] [Resolved] (SPARK-51289) Internal error on RETURNS TABLE

2025-05-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51289. -- Assignee: Max Gekk Resolution: Fixed > Internal error on RETURNS TABLE > ---