[jira] [Resolved] (SPARK-52836) Fix `sparkapp.sh` to let Spark driver determine pod memory

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52836. --- Fix Version/s: kubernetes-operator-0.5.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-52251) Use `crd-generator-cli` to generate CRDs

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52251: -- Description: {code:java} > Task :spark-operator-api:compileJava ... warning: This version of t

[jira] [Updated] (SPARK-52835) Fix the default value of `operatorContainer` memory to 2Gi from 4Gi

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52835: -- Description: (was: {code:java} > Task :spark-operator-api:compileJava ... warning: This ver

[jira] [Updated] (SPARK-52835) Fix the default value of `operatorContainer` memory to 2Gi from 4Gi

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52835: -- Description: {code:java} > Task :spark-operator-api:compileJava ... warning: This version of t

[jira] [Resolved] (SPARK-52835) Fix the default value of `operatorContainer` memory to 2Gi from 4Gi

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52835. --- Fix Version/s: kubernetes-operator-0.5.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-52836) Fix `sparkapp.sh` to let Spark driver determine pod memory

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52836: - Assignee: Dongjoon Hyun > Fix `sparkapp.sh` to let Spark driver determine pod memory >

[jira] [Created] (SPARK-52836) Fix `sparkapp.sh` to let Spark driver determine pod memory

2025-07-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52836: - Summary: Fix `sparkapp.sh` to let Spark driver determine pod memory Key: SPARK-52836 URL: https://issues.apache.org/jira/browse/SPARK-52836 Project: Spark

[jira] [Updated] (SPARK-52836) Fix `sparkapp.sh` to let Spark driver determine pod memory

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52836: --- Labels: pull-request-available (was: ) > Fix `sparkapp.sh` to let Spark driver determine po

[jira] [Assigned] (SPARK-52835) Fix the default value of `operatorContainer` memory to 2Gi from 4Gi

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52835: - Assignee: Dongjoon Hyun > Fix the default value of `operatorContainer` memory to 2Gi fr

[jira] [Updated] (SPARK-52835) Fix the default value of `operatorContainer` memory to 2Gi from 4Gi

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52835: --- Labels: pull-request-available (was: ) > Fix the default value of `operatorContainer` memor

[jira] [Created] (SPARK-52835) Fix the default value of `operatorContainer` memory to 2Gi from 4Gi

2025-07-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52835: - Summary: Fix the default value of `operatorContainer` memory to 2Gi from 4Gi Key: SPARK-52835 URL: https://issues.apache.org/jira/browse/SPARK-52835 Project: Spark

[jira] [Resolved] (SPARK-52830) Support `spark.kubernetes.(driver|executor).pod.excludedFeatureSteps`

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52830. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51522 [https://

[jira] [Assigned] (SPARK-52830) Support `spark.kubernetes.(driver|executor).pod.excludedFeatureSteps`

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52830: - Assignee: Dongjoon Hyun > Support `spark.kubernetes.(driver|executor).pod.excludedFeatu

[jira] [Commented] (SPARK-52824) Classify errors thrown from CheckpointFileManager.create

2025-07-16 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007697#comment-18007697 ] Anish Shrigondekar commented on SPARK-52824: PR has been merged > Classify

[jira] [Resolved] (SPARK-52824) Classify errors thrown from CheckpointFileManager.create

2025-07-16 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar resolved SPARK-52824. Resolution: Fixed > Classify errors thrown from CheckpointFileManager.create > ---

[jira] [Assigned] (SPARK-52824) Classify errors thrown from CheckpointFileManager.create

2025-07-16 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar reassigned SPARK-52824: -- Assignee: Livia Zhu > Classify errors thrown from CheckpointFileManager.creat

[jira] [Resolved] (SPARK-52214) Python Arrow UDF

2025-07-16 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-52214. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51292 [https://

[jira] [Resolved] (SPARK-52795) Include runId in state store logs

2025-07-16 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar resolved SPARK-52795. Resolution: Fixed > Include runId in state store logs > --

[jira] [Updated] (SPARK-52820) Capture full plans in golden files

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52820: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Test) > Capture full plans in golden f

[jira] [Assigned] (SPARK-52820) Capture full plans in golden files

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52820: - Assignee: Peter Toth > Capture full plans in golden files > ---

[jira] [Resolved] (SPARK-52820) Capture full plans in golden files

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52820. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51512 [https://

[jira] [Resolved] (SPARK-52831) Revise the default logging layout to include only name & namespace MDC Keys

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52831. --- Fix Version/s: kubernetes-operator-0.5.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-52831) Revise the default logging layout to include only name & namespace MDC Keys

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52831: - Assignee: Zhou JIANG > Revise the default logging layout to include only name & namespa

[jira] [Resolved] (SPARK-52834) Improve `ProbeService` to show the port number

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52834. --- Fix Version/s: kubernetes-operator-0.5.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-52829) Fix LocalDataToArrowConversion.convert to handle empty rows properly

2025-07-16 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-52829: - Assignee: Takuya Ueshin > Fix LocalDataToArrowConversion.convert to handle empty rows p

[jira] [Resolved] (SPARK-52829) Fix LocalDataToArrowConversion.convert to handle empty rows properly

2025-07-16 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-52829. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51523 [https://

[jira] [Updated] (SPARK-51741) Remove --ONLY_IF spark for subquery tests

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51741: --- Labels: pull-request-available (was: ) > Remove --ONLY_IF spark for subquery tests > --

[jira] [Assigned] (SPARK-52834) Improve `ProbeService` to show the port number

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52834: - Assignee: Dongjoon Hyun > Improve `ProbeService` to show the port number >

[jira] [Updated] (SPARK-52834) Improve `ProbeService` to show the port number

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52834: --- Labels: pull-request-available (was: ) > Improve `ProbeService` to show the port number > -

[jira] [Created] (SPARK-52834) Improve `ProbeService` to show the port number

2025-07-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52834: - Summary: Improve `ProbeService` to show the port number Key: SPARK-52834 URL: https://issues.apache.org/jira/browse/SPARK-52834 Project: Spark Issue Type:

[jira] [Updated] (SPARK-52833) Fix VariantBuilder.appendFloat

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52833: --- Labels: pull-request-available (was: ) > Fix VariantBuilder.appendFloat > -

[jira] [Created] (SPARK-52833) Fix VariantBuilder.appendFloat

2025-07-16 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-52833: -- Summary: Fix VariantBuilder.appendFloat Key: SPARK-52833 URL: https://issues.apache.org/jira/browse/SPARK-52833 Project: Spark Issue Type: Sub-task Com

[jira] [Created] (SPARK-52832) Fix oracle dialect identifier quoting

2025-07-16 Thread Uros Stankovic (Jira)
Uros Stankovic created SPARK-52832: -- Summary: Fix oracle dialect identifier quoting Key: SPARK-52832 URL: https://issues.apache.org/jira/browse/SPARK-52832 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-52831) Revise the default logging layout to include only name & namespace MDC Keys

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52831: --- Labels: pull-request-available (was: ) > Revise the default logging layout to include only

[jira] [Created] (SPARK-52831) Revise the default logging layout to include only name & namespace MDC Keys

2025-07-16 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-52831: -- Summary: Revise the default logging layout to include only name & namespace MDC Keys Key: SPARK-52831 URL: https://issues.apache.org/jira/browse/SPARK-52831 Project: Spa

[jira] [Assigned] (SPARK-52811) Improve ArrowTableToRowsConversion.convert performance

2025-07-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52811: Assignee: Takuya Ueshin > Improve ArrowTableToRowsConversion.convert performance > --

[jira] [Resolved] (SPARK-52811) Improve ArrowTableToRowsConversion.convert performance

2025-07-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52811. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51508 [https://gi

[jira] [Updated] (SPARK-52679) Revise `appender.console.layout.pattern` to include MDC keys and thread name

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52679: --- Labels: pull-request-available (was: ) > Revise `appender.console.layout.pattern` to includ

[jira] [Updated] (SPARK-52641) Primary key columns should not be nullable

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52641: --- Labels: pull-request-available (was: ) > Primary key columns should not be nullable > -

[jira] [Updated] (SPARK-52641) Primary key columns should not be nullable

2025-07-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-52641: --- Description: When creating or replacing a table with primary key, all the columns of the pr

[jira] [Updated] (SPARK-52829) Fix LocalDataToArrowConversion.convert to handle empty rows properly

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52829: --- Labels: pull-request-available (was: ) > Fix LocalDataToArrowConversion.convert to handle e

[jira] [Updated] (SPARK-52830) Support `spark.kubernetes.(driver|executor).pod.excludedFeatureSteps`

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52830: --- Labels: pull-request-available (was: ) > Support `spark.kubernetes.(driver|executor).pod.ex

[jira] [Created] (SPARK-52830) Support `spark.kubernetes.(driver|executor).pod.excludedFeatureSteps`

2025-07-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52830: - Summary: Support `spark.kubernetes.(driver|executor).pod.excludedFeatureSteps` Key: SPARK-52830 URL: https://issues.apache.org/jira/browse/SPARK-52830 Project: Spar

[jira] [Created] (SPARK-52829) Fix LocalDataToArrowConversion.convert to handle empty rows properly

2025-07-16 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-52829: - Summary: Fix LocalDataToArrowConversion.convert to handle empty rows properly Key: SPARK-52829 URL: https://issues.apache.org/jira/browse/SPARK-52829 Project: Spark

[jira] [Resolved] (SPARK-52827) Add `pi-with-template.yaml` example

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52827. --- Fix Version/s: kubernetes-operator-0.5.0 Resolution: Fixed Issue resolved by pull req

[jira] [Commented] (SPARK-52823) Support Oracle connector for DSv2 Join pushdown

2025-07-16 Thread Petar Vasiljevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007662#comment-18007662 ] Petar Vasiljevic commented on SPARK-52823: -- PR: https://github.com/apache/spark

[jira] [Updated] (SPARK-52828) Make hashing for collated strings collation agnostic

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52828: --- Labels: pull-request-available (was: ) > Make hashing for collated strings collation agnost

[jira] [Created] (SPARK-52828) Make hashing for collated strings collation agnostic

2025-07-16 Thread Jira
Uroš Bojanić created SPARK-52828: Summary: Make hashing for collated strings collation agnostic Key: SPARK-52828 URL: https://issues.apache.org/jira/browse/SPARK-52828 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-52827) Add `pi-with-template.yaml` example

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52827: - Assignee: Dongjoon Hyun > Add `pi-with-template.yaml` example > ---

[jira] [Updated] (SPARK-52511) Support "dry-run" in the spark-pipelines CLI

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52511: --- Labels: pull-request-available (was: ) > Support "dry-run" in the spark-pipelines CLI > ---

[jira] [Assigned] (SPARK-52755) Remove ConfigMap informer from config reconciler

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52755: - Assignee: Attila Mészáros > Remove ConfigMap informer from config reconciler >

[jira] [Resolved] (SPARK-52755) Remove ConfigMap informer from config reconciler

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52755. --- Resolution: Fixed Issue resolved by pull request 281 [https://github.com/apache/spark-kubern

[jira] [Updated] (SPARK-52827) Add `pi-with-template.yaml` example

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52827: --- Labels: pull-request-available (was: ) > Add `pi-with-template.yaml` example >

[jira] [Created] (SPARK-52827) Add `pi-with-template.yaml` example

2025-07-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52827: - Summary: Add `pi-with-template.yaml` example Key: SPARK-52827 URL: https://issues.apache.org/jira/browse/SPARK-52827 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52826) Support table arguments in User Defined Table Functions

2025-07-16 Thread Shujing Yang (Jira)
Shujing Yang created SPARK-52826: Summary: Support table arguments in User Defined Table Functions Key: SPARK-52826 URL: https://issues.apache.org/jira/browse/SPARK-52826 Project: Spark Issue

[jira] [Updated] (SPARK-52823) Support Oracle connector for DSv2 Join pushdown

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52823: --- Labels: pull-request-available (was: ) > Support Oracle connector for DSv2 Join pushdown >

[jira] [Updated] (SPARK-52804) Add a check for the Java version used to build Spark

2025-07-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52804: -- Summary: Add a check for the Java version used to build Spark (was: Issue with proc:full on o

[jira] [Created] (SPARK-52825) Additional dialect support

2025-07-16 Thread Karen Chen (Jira)
Karen Chen created SPARK-52825: -- Summary: Additional dialect support Key: SPARK-52825 URL: https://issues.apache.org/jira/browse/SPARK-52825 Project: Spark Issue Type: Improvement Comp

[jira] [Updated] (SPARK-52824) Classify errors thrown from CheckpointFileManager.create

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52824: --- Labels: pull-request-available (was: ) > Classify errors thrown from CheckpointFileManager.

[jira] [Created] (SPARK-52824) Classify errors thrown from CheckpointFileManager.create

2025-07-16 Thread Livia Zhu (Jira)
Livia Zhu created SPARK-52824: - Summary: Classify errors thrown from CheckpointFileManager.create Key: SPARK-52824 URL: https://issues.apache.org/jira/browse/SPARK-52824 Project: Spark Issue Type

[jira] [Created] (SPARK-52823) Support Oracle connector for DSv2 Join pushdown

2025-07-16 Thread Petar Vasiljevic (Jira)
Petar Vasiljevic created SPARK-52823: Summary: Support Oracle connector for DSv2 Join pushdown Key: SPARK-52823 URL: https://issues.apache.org/jira/browse/SPARK-52823 Project: Spark Issue

[jira] [Updated] (SPARK-52823) Support Oracle connector for DSv2 Join pushdown

2025-07-16 Thread Petar Vasiljevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Petar Vasiljevic updated SPARK-52823: - Description: In https://issues.apache.org/jira/browse/SPARK-52187 we have introduced Joi

[jira] [Assigned] (SPARK-52814) Upgrade zstd-jni to 1.5.7-4

2025-07-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-52814: Assignee: Yang Jie (was: Junqing Li) > Upgrade zstd-jni to 1.5.7-4 > ---

[jira] [Assigned] (SPARK-52804) Issue with proc:full on older versions of Java 17

2025-07-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-52804: Assignee: Yang Jie (was: Uroš Bojanić) > Issue with proc:full on older versions of Java 17 > ---

[jira] [Assigned] (SPARK-52804) Issue with proc:full on older versions of Java 17

2025-07-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-52804: Assignee: Uroš Bojanić > Issue with proc:full on older versions of Java 17 >

[jira] [Resolved] (SPARK-52804) Issue with proc:full on older versions of Java 17

2025-07-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-52804. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51514 [https://github.com

[jira] [Updated] (SPARK-52776) ProcfsMetricsGetter splits the comm field if it contains space characters

2025-07-16 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-52776: Fix Version/s: 3.5.7 > ProcfsMetricsGetter splits the comm field if it contains sp

[jira] [Updated] (SPARK-52776) ProcfsMetricsGetter splits the comm field if it contains space characters

2025-07-16 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-52776: Affects Version/s: 4.1.0 > ProcfsMetricsGetter splits the comm field if it contain

[jira] [Updated] (SPARK-52813) Allow a query to be defined as a DAG

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52813: --- Labels: pull-request-available (was: ) > Allow a query to be defined as a DAG > ---

[jira] [Commented] (SPARK-52448) Add simplified Struct Expression.Literal

2025-07-16 Thread Yihong He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007583#comment-18007583 ] Yihong He commented on SPARK-52448: --- I would like to try doing this   > Add simplifie

[jira] [Commented] (SPARK-51434) jakarta.servlet Version 5 => 6

2025-07-16 Thread John (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18007570#comment-18007570 ] John commented on SPARK-51434: -- Creating a copy of the jakarta.servlet.SingleThreadModel in

[jira] [Updated] (SPARK-52822) Update Derby to 10.17.1.0

2025-07-16 Thread Cameron (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cameron updated SPARK-52822: Description: Upgrading derby from 10.16.1.1 to 10.17.1.0 removes the following vulnerability from the com

[jira] [Updated] (SPARK-52817) Spark SQL LIKE expressions show poor performance when using multiple '%'

2025-07-16 Thread zhixingheyi-tian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhixingheyi-tian updated SPARK-52817: - Description:   ``` SELECT * FROM testData where value not like '%%HotFocus%%' SELECT * F

[jira] [Updated] (SPARK-52817) Spark SQL LIKE expressions show poor performance when using multiple '%'

2025-07-16 Thread zhixingheyi-tian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhixingheyi-tian updated SPARK-52817: - Description:   ``` SELECT * FROM testData where value not like '%%HotFocus%%' SELECT * F

[jira] [Created] (SPARK-52822) Update Derby to 10.16.1.2

2025-07-16 Thread Cameron (Jira)
Cameron created SPARK-52822: --- Summary: Update Derby to 10.16.1.2 Key: SPARK-52822 URL: https://issues.apache.org/jira/browse/SPARK-52822 Project: Spark Issue Type: Dependency upgrade Comp

[jira] [Updated] (SPARK-52821) Support int to DecimalType return type coercion in Pandas UDFs (useArrow=True)

2025-07-16 Thread Ben Hurdelhey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Hurdelhey updated SPARK-52821: -- Description: Problem: pyspark UDFs with useArrow=True do not support type coercion from int t

[jira] [Updated] (SPARK-52821) Support int to DecimalType return type coercion in Pandas UDFs (useArrow=True)

2025-07-16 Thread Ben Hurdelhey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Hurdelhey updated SPARK-52821: -- Attachment: Screenshot 2025-07-16 at 11.49.31.png > Support int to DecimalType return type coe

[jira] [Updated] (SPARK-52821) Support int to DecimalType return type coercion in Pandas UDFs (useArrow=True)

2025-07-16 Thread Ben Hurdelhey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Hurdelhey updated SPARK-52821: -- Description: Problem: pyspark UDFs with useArrow=True do not support type coercion from int t

[jira] [Created] (SPARK-52821) Support int to DecimalType return type coercion in Python UDFs

2025-07-16 Thread Ben Hurdelhey (Jira)
Ben Hurdelhey created SPARK-52821: - Summary: Support int to DecimalType return type coercion in Python UDFs Key: SPARK-52821 URL: https://issues.apache.org/jira/browse/SPARK-52821 Project: Spark

[jira] [Updated] (SPARK-52821) Support int to DecimalType return type coercion in Pandas UDFs (useArrow=True)

2025-07-16 Thread Ben Hurdelhey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Hurdelhey updated SPARK-52821: -- Summary: Support int to DecimalType return type coercion in Pandas UDFs (useArrow=True) (was:

[jira] [Updated] (SPARK-52820) Don't truncate plans in golden files

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52820: --- Labels: pull-request-available (was: ) > Don't truncate plans in golden files > ---

[jira] [Updated] (SPARK-52820) Capture full plans in golden files

2025-07-16 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-52820: --- Summary: Capture full plans in golden files (was: Don't truncate plans in golden files) > Capture

[jira] [Created] (SPARK-52820) Don't truncate plans in golden files

2025-07-16 Thread Peter Toth (Jira)
Peter Toth created SPARK-52820: -- Summary: Don't truncate plans in golden files Key: SPARK-52820 URL: https://issues.apache.org/jira/browse/SPARK-52820 Project: Spark Issue Type: Test C

[jira] [Assigned] (SPARK-52814) Upgrade zstd-jni to 1.5.7-4

2025-07-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-52814: Assignee: Junqing Li > Upgrade zstd-jni to 1.5.7-4 > --- > >

[jira] [Resolved] (SPARK-52814) Upgrade zstd-jni to 1.5.7-4

2025-07-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-52814. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51492 [https://github.com

[jira] [Updated] (SPARK-52814) Upgrade zstd-jni to 1.5.7-4

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52814: --- Labels: pull-request-available (was: ) > Upgrade zstd-jni to 1.5.7-4 >

[jira] [Updated] (SPARK-52803) Update aws-java-sdk-sts to 1.12.720

2025-07-16 Thread Cameron (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cameron updated SPARK-52803: Description: (was: Upgrading aws-java-sdk-s3 from 1.11.655 to 1.12.261 resolves the following vulnerab

[jira] [Updated] (SPARK-46941) Can't insert window group limit node for top-k computation if contains SizeBasedWindowFunction

2025-07-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46941: Fix Version/s: 3.5.7 > Can't insert window group limit node for top-k computation if contains > S

[jira] [Resolved] (SPARK-52619) Cast TimeType to IntegralType

2025-07-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52619. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51461 [https://github.com

[jira] [Assigned] (SPARK-52619) Cast TimeType to IntegralType

2025-07-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-52619: Assignee: Mike Artz > Cast TimeType to IntegralType > - > >

[jira] [Updated] (SPARK-52214) Python Arrow UDF

2025-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52214: --- Labels: pull-request-available (was: ) > Python Arrow UDF > > >

[jira] [Updated] (SPARK-52819) Structured Streaming: FlatMapGroupsWithState: java.io.NotSerializableException: org.apache.spark.sql.catalyst.encoders.KryoSerializationCodec$

2025-07-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-52819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quirin Kögl updated SPARK-52819: Description: When trying to use a kryo serializer for the State using the Dataset.flatMapGroupsWi

[jira] [Updated] (SPARK-52819) Structured Streaming: FlatMapGroupsWithState: java.io.NotSerializableException: org.apache.spark.sql.catalyst.encoders.KryoSerializationCodec$

2025-07-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-52819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quirin Kögl updated SPARK-52819: Attachment: Main.java > Structured Streaming: FlatMapGroupsWithState: > java.io.NotSerializableEx

[jira] [Created] (SPARK-52818) Arrow UDF for aggregation

2025-07-16 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-52818: - Summary: Arrow UDF for aggregation Key: SPARK-52818 URL: https://issues.apache.org/jira/browse/SPARK-52818 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-52819) Structured Streaming: FlatMapGroupsWithState: java.io.NotSerializableException: org.apache.spark.sql.catalyst.encoders.KryoSerializationCodec$

2025-07-16 Thread Jira
Quirin Kögl created SPARK-52819: --- Summary: Structured Streaming: FlatMapGroupsWithState: java.io.NotSerializableException: org.apache.spark.sql.catalyst.encoders.KryoSerializationCodec$ Key: SPARK-52819 URL: https:

[jira] [Assigned] (SPARK-52815) Improve `SparkClassUtils` to support `getAllInterfaces`

2025-07-16 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth reassigned SPARK-52815: -- Assignee: Dongjoon Hyun > Improve `SparkClassUtils` to support `getAllInterfaces` > -

[jira] [Resolved] (SPARK-52815) Improve `SparkClassUtils` to support `getAllInterfaces`

2025-07-16 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth resolved SPARK-52815. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51509 [https://github

[jira] [Updated] (SPARK-52817) Spark SQL LIKE expressions show poor performance when using multiple '%'

2025-07-16 Thread zhixingheyi-tian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhixingheyi-tian updated SPARK-52817: - Description:   ``` SELECT * FROM testData where value not like '%%HotFocus%%' SELECT * F

[jira] [Resolved] (SPARK-52779) Support Time literal in connect

2025-07-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52779. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51462 [https://github.com

[jira] [Assigned] (SPARK-52779) Support Time literal in connect

2025-07-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-52779: Assignee: Deng Ziming > Support Time literal in connect > --- > >

  1   2   >