[jira] [Updated] (SPARK-45903) Different column orders lead to OOM

2023-11-12 Thread liang.feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang.feng updated SPARK-45903: --- Description:   Problem description:  I am using spark to generate HFile, OOM occurs in the

[jira] [Updated] (SPARK-45903) Different column orders lead to OOM

2023-11-12 Thread liang.feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang.feng updated SPARK-45903: --- Issue Type: Bug (was: Question) > Different column orders lead to OOM >

[jira] [Updated] (SPARK-45903) Different column orders lead to OOM

2023-11-12 Thread liang.feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang.feng updated SPARK-45903: --- Description:   Problem description:  I am using spark to generate HFile, OOM occurs in the

[jira] [Updated] (SPARK-45903) Different column orders lead to OOM

2023-11-12 Thread liang.feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang.feng updated SPARK-45903: --- Attachment: image-2023-11-13-15-47-01-764.png > Different column orders lead to OOM >

[jira] [Updated] (SPARK-45903) Different column orders lead to OOM

2023-11-12 Thread liang.feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang.feng updated SPARK-45903: --- Attachment: image-2023-11-13-15-46-16-868.png > Different column orders lead to OOM >

[jira] [Updated] (SPARK-45903) Different column orders lead to OOM

2023-11-12 Thread liang.feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang.feng updated SPARK-45903: --- Description:   Problem description:  I am using spark to generate HFile, OOM occurs in the

[jira] [Created] (SPARK-45903) Different column orders lead to OOM

2023-11-12 Thread liang.feng (Jira)
liang.feng created SPARK-45903: -- Summary: Different column orders lead to OOM Key: SPARK-45903 URL: https://issues.apache.org/jira/browse/SPARK-45903 Project: Spark Issue Type: Question

[jira] [Updated] (SPARK-45902) Remove unused function `resolvePartitionColumns` from `DataSource`

2023-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45902: --- Labels: pull-request-available (was: ) > Remove unused function `resolvePartitionColumns`

[jira] [Created] (SPARK-45902) Remove unused function `resolvePartitionColumns` from `DataSource`

2023-11-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-45902: Summary: Remove unused function `resolvePartitionColumns` from `DataSource` Key: SPARK-45902 URL: https://issues.apache.org/jira/browse/SPARK-45902 Project: Spark

[jira] [Commented] (SPARK-45522) Migrate jetty 9 to jetty 12

2023-11-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785370#comment-17785370 ] Yang Jie commented on SPARK-45522: -- Yes, it's June 2024. According to the previous plan, Apache Spark

[jira] [Commented] (SPARK-45644) After upgrading to Spark 3.4.1 and 3.5.0 we receive RuntimeException "scala.Some is not a valid external type for schema of array"

2023-11-12 Thread Adi Wehrli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785362#comment-17785362 ] Adi Wehrli commented on SPARK-45644: Thanks very much, [~bersprockets]. (y) > After upgrading to

[jira] [Comment Edited] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-11-12 Thread Yiu-Chung Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785356#comment-17785356 ] Yiu-Chung Lee edited comment on SPARK-44512 at 11/13/23 3:34 AM: -

[jira] [Commented] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-11-12 Thread Yiu-Chung Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785356#comment-17785356 ] Yiu-Chung Lee commented on SPARK-44512: --- [~dongjoon] As I mentioned before, I need to preserve the

[jira] [Updated] (SPARK-45896) Expression encoding fails for Seq/Map of Option[Seq/Date/Timestamp/BigDecimal]

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45896: -- Fix Version/s: 3.4.2 > Expression encoding fails for Seq/Map of

[jira] [Updated] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter

2023-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-37287: --- Labels: pull-request-available (was: ) > Pull out dynamic partition and bucket sort from

[jira] [Resolved] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44512. --- Resolution: Not A Problem > dataset.sort.select.write.partitionBy sorts wrong column >

[jira] [Updated] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44512: -- Target Version/s: (was: 3.4.2) > dataset.sort.select.write.partitionBy sorts wrong column >

[jira] [Updated] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44512: -- Labels: (was: correctness) > dataset.sort.select.write.partitionBy sorts wrong column >

[jira] [Closed] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-44512. - > dataset.sort.select.write.partitionBy sorts wrong column >

[jira] [Commented] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785352#comment-17785352 ] Dongjoon Hyun commented on SPARK-44512: --- In general, I believe that the users report this as an

[jira] [Commented] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785350#comment-17785350 ] Dongjoon Hyun commented on SPARK-44512: --- I reproduced [~leeyc0]'s report like the following.

[jira] [Resolved] (SPARK-45901) Collect and update `spark-standalone.md` with new confs

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45901. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43774

[jira] [Resolved] (SPARK-45733) (Python) Support different retry policies for connect client

2023-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45733. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43591

[jira] [Assigned] (SPARK-45733) (Python) Support different retry policies for connect client

2023-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45733: Assignee: Alice Sayutina > (Python) Support different retry policies for connect client

[jira] [Updated] (SPARK-43301) BlockStoreClient getHostLocalDirs RPC supports IOException retry

2023-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43301: --- Labels: pull-request-available (was: ) > BlockStoreClient getHostLocalDirs RPC supports

[jira] [Updated] (SPARK-43025) Eliminate Union if filters have the same child plan

2023-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43025: --- Labels: pull-request-available (was: ) > Eliminate Union if filters have the same child

[jira] [Updated] (SPARK-44203) The obtainDelegationTokens method of HiveDelegationTokenProvider should return nextRenewalDate instead of None

2023-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44203: --- Labels: pull-request-available (was: ) > The obtainDelegationTokens method of

[jira] [Resolved] (SPARK-45899) Set errorClass in errorInfoToThrowable

2023-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45899. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43772

[jira] [Assigned] (SPARK-45899) Set errorClass in errorInfoToThrowable

2023-11-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45899: Assignee: Yihong He > Set errorClass in errorInfoToThrowable >

[jira] [Updated] (SPARK-45900) Expand hash functionalities from to include XXH3

2023-11-12 Thread Nathan Holland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Holland updated SPARK-45900: --- Description: I often work in projects that require deterministic randomness, especially

[jira] [Updated] (SPARK-45900) Expand hash functionalities from to include XXH3

2023-11-12 Thread Nathan Holland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Holland updated SPARK-45900: --- Description: I often work in projects that require deterministic randomness, especially

[jira] [Updated] (SPARK-45900) Expand hash functionalities from to include XXH3

2023-11-12 Thread Nathan Holland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Holland updated SPARK-45900: --- Description: I often work in projects that require deterministic randomness, especially

[jira] [Created] (SPARK-45900) Update hash functionalities from xxHash64 to XXH3

2023-11-12 Thread Nathan Holland (Jira)
Nathan Holland created SPARK-45900: -- Summary: Update hash functionalities from xxHash64 to XXH3 Key: SPARK-45900 URL: https://issues.apache.org/jira/browse/SPARK-45900 Project: Spark Issue

[jira] [Updated] (SPARK-45900) Expand hash functionalities from to include XXH3

2023-11-12 Thread Nathan Holland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Holland updated SPARK-45900: --- Summary: Expand hash functionalities from to include XXH3 (was: Update hash

[jira] [Resolved] (SPARK-45857) Enforce the error classes in sub-classes of AnalysisException

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45857. --- Resolution: Fixed Issue resolved by pull request 43731

[jira] [Assigned] (SPARK-45848) spark-build-info.ps1 missing the docroot property

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45848: - Assignee: Yang Jie (was: Yuming Wang) > spark-build-info.ps1 missing the docroot

[jira] [Resolved] (SPARK-45848) spark-build-info.ps1 missing the docroot property

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45848. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43726

[jira] [Assigned] (SPARK-45848) spark-build-info.ps1 missing the docroot property

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45848: - Assignee: Yuming Wang > spark-build-info.ps1 missing the docroot property >

[jira] [Assigned] (SPARK-45830) Refactor StorageUtils#bufferCleaner

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45830: - Assignee: Yang Jie > Refactor StorageUtils#bufferCleaner >

[jira] [Resolved] (SPARK-45830) Refactor StorageUtils#bufferCleaner

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45830. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43675

[jira] [Resolved] (SPARK-45874) Remove Java version check from `IsolatedClientLoader`

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45874. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43747

[jira] [Assigned] (SPARK-45874) Remove Java version check from `IsolatedClientLoader`

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45874: - Assignee: Yang Jie > Remove Java version check from `IsolatedClientLoader` >

[jira] [Resolved] (SPARK-45896) Expression encoding fails for Seq/Map of Option[Seq/Date/Timestamp/BigDecimal]

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45896. --- Fix Version/s: 4.0.0 3.5.1 Assignee: Bruce Robbins

[jira] [Resolved] (SPARK-45770) Fix column resolution in DataFrame.drop

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45770. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43683

[jira] [Resolved] (SPARK-45886) Output full stack trace in callSite of DataFrame context

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45886. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43758

[jira] [Resolved] (SPARK-45875) Remove `MissingStageTableRowData` from `core` module

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45875. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43748

[jira] [Assigned] (SPARK-45875) Remove `MissingStageTableRowData` from `core` module

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45875: - Assignee: Yang Jie > Remove `MissingStageTableRowData` from `core` module >

[jira] [Resolved] (SPARK-45870) Upgrade action/checkout to v4

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45870. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43744

[jira] [Assigned] (SPARK-45282) Join loses records for cached datasets

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45282: - Assignee: Emil Ejbyfeldt > Join loses records for cached datasets >

[jira] [Resolved] (SPARK-45282) Join loses records for cached datasets

2023-11-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45282. --- Fix Version/s: 3.4.2 Resolution: Fixed Issue resolved by pull request 43729

[jira] [Updated] (SPARK-45899) Set errorClass in errorInfoToThrowable

2023-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45899: --- Labels: pull-request-available (was: ) > Set errorClass in errorInfoToThrowable >

[jira] [Created] (SPARK-45899) Set errorClass in errorInfoToThrowable

2023-11-12 Thread Yihong He (Jira)
Yihong He created SPARK-45899: - Summary: Set errorClass in errorInfoToThrowable Key: SPARK-45899 URL: https://issues.apache.org/jira/browse/SPARK-45899 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45898: --- Labels: pull-request-available (was: ) > Rewrite catalog table APIs to use unresolved

[jira] [Created] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-12 Thread Yihong He (Jira)
Yihong He created SPARK-45898: - Summary: Rewrite catalog table APIs to use unresolved logical plan Key: SPARK-45898 URL: https://issues.apache.org/jira/browse/SPARK-45898 Project: Spark Issue

[jira] [Commented] (SPARK-45190) XML: StructType schema issue in pyspark connect

2023-11-12 Thread Hannah Amundson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785303#comment-17785303 ] Hannah Amundson commented on SPARK-45190: - I have started on this ticket > XML: StructType

[jira] [Updated] (SPARK-45897) java.lang.NoClassDefFoundError: javax/servlet/Servlet incompatibilities upgrading springboot-dependencies 2.7 to 3.* (package javax.* -> jakarta.*)

2023-11-12 Thread Arnaud Nauwynck (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-45897: Description: updating springboot-dependencies 2.7 to 3.1 breaks spark with springboot

[jira] [Updated] (SPARK-45897) java.lang.NoClassDefFoundError: javax/servlet/Servlet incompatibilities upgrading springboot-dependencies 2.7 to 3.* (package javax.* -> jakarta.*)

2023-11-12 Thread Arnaud Nauwynck (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-45897: Attachment: test-springboot-spark.zip > java.lang.NoClassDefFoundError:

[jira] [Updated] (SPARK-45897) java.lang.NoClassDefFoundError: javax/servlet/Servlet incompatibilities upgrading springboot-dependencies 2.7 to 3.* (package javax.* -> jakarta.*)

2023-11-12 Thread Arnaud Nauwynck (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-45897: Description: updating springboot-dependencies 2.7 to 3.1 breaks spark with springboot

[jira] [Created] (SPARK-45897) java.lang.NoClassDefFoundError: javax/servlet/Servlet incompatibilities upgrading springboot-dependencies 2.7 to 3.* (package javax.* -> jakarta.*)

2023-11-12 Thread Arnaud Nauwynck (Jira)
Arnaud Nauwynck created SPARK-45897: --- Summary: java.lang.NoClassDefFoundError: javax/servlet/Servlet incompatibilities upgrading springboot-dependencies 2.7 to 3.* (package javax.* -> jakarta.*) Key: SPARK-45897

[jira] [Updated] (SPARK-45896) Expression encoding fails for Seq/Map of Option[Seq/Date/Timestamp/BigDecimal]

2023-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45896: --- Labels: pull-request-available (was: ) > Expression encoding fails for Seq/Map of

[jira] [Updated] (SPARK-44493) Extract pushable predicates from disjunctive predicates

2023-11-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44493: --- Labels: pull-request-available (was: ) > Extract pushable predicates from disjunctive

[jira] [Commented] (SPARK-45522) Migrate jetty 9 to jetty 12

2023-11-12 Thread HiuFung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785289#comment-17785289 ] HiuFung commented on SPARK-45522: - [~LuciferYang] Just to be sure, is that 2024 June? If that is the

[jira] [Comment Edited] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

2023-11-12 Thread Marc Le Bihan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275 ] Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 11:28 AM: -- The

[jira] [Comment Edited] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

2023-11-12 Thread Marc Le Bihan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275 ] Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 10:56 AM: -- The

[jira] [Comment Edited] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

2023-11-12 Thread Marc Le Bihan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275 ] Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 10:56 AM: -- The

[jira] [Comment Edited] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

2023-11-12 Thread Marc Le Bihan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275 ] Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 10:55 AM: -- The

[jira] [Commented] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

2023-11-12 Thread Marc Le Bihan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275 ] Marc Le Bihan commented on SPARK-45311: --- The problem *java.util.NoSuchElementException: None.get*  

[jira] [Comment Edited] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

2023-11-12 Thread Marc Le Bihan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275 ] Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 10:55 AM: -- The