[jira] [Updated] (SPARK-37258) Upgrade kubernetes-client to 5.12.0

[ https://issues.apache.org/jira/browse/SPARK-37258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37258: -- Summary: Upgrade kubernetes-client to 5.12.0 (was: Upgrade kubernetes-client >= 5.11.0 to

[jira] [Resolved] (SPARK-37258) Upgrade kubernetes-client >= 5.11.0 to support Volcano

[ https://issues.apache.org/jira/browse/SPARK-37258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37258. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34939

[jira] [Updated] (SPARK-38013) Fix AQE can change bhj to smj if no extra shuffle introduce

[ https://issues.apache.org/jira/browse/SPARK-38013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38013: -- Summary: Fix AQE can change bhj to smj if no extra shuffle introduce (was: Fix AQE can change bhj to

[jira] [Assigned] (SPARK-37258) Upgrade kubernetes-client >= 5.11.0 to support Volcano

[ https://issues.apache.org/jira/browse/SPARK-37258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37258: - Assignee: Yikun Jiang > Upgrade kubernetes-client >= 5.11.0 to support Volcano >

[jira] [Commented] (SPARK-38010) Push-based shuffle disabled due to insufficient mergeLocations

[ https://issues.apache.org/jira/browse/SPARK-38010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481614#comment-17481614 ] gaoyajun02 commented on SPARK-38010: https://issues.apache.org/jira/browse/SPARK-34826 can solve it?

[jira] [Assigned] (SPARK-38018) Fix ColumnVectorUtils.populate to handle CalendarIntervalType correctly

[ https://issues.apache.org/jira/browse/SPARK-38018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38018: Assignee: (was: Apache Spark) > Fix ColumnVectorUtils.populate to handle

[jira] [Assigned] (SPARK-38018) Fix ColumnVectorUtils.populate to handle CalendarIntervalType correctly

[ https://issues.apache.org/jira/browse/SPARK-38018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38018: Assignee: Apache Spark > Fix ColumnVectorUtils.populate to handle CalendarIntervalType

[jira] [Commented] (SPARK-38018) Fix ColumnVectorUtils.populate to handle CalendarIntervalType correctly

[ https://issues.apache.org/jira/browse/SPARK-38018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481607#comment-17481607 ] Apache Spark commented on SPARK-38018: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-38018) Fix ColumnVectorUtils.populate to handle CalendarIntervalType correctly

Cheng Su created SPARK-38018: Summary: Fix ColumnVectorUtils.populate to handle CalendarIntervalType correctly Key: SPARK-38018 URL: https://issues.apache.org/jira/browse/SPARK-38018 Project: Spark

[jira] [Commented] (SPARK-38017) Fix the API doc for window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481597#comment-17481597 ] Apache Spark commented on SPARK-38017: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38017) Fix the API doc for window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38017: Assignee: Apache Spark (was: Kousuke Saruta) > Fix the API doc for window to say it

[jira] [Assigned] (SPARK-38017) Fix the API doc for window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38017: Assignee: Kousuke Saruta (was: Apache Spark) > Fix the API doc for window to say it

[jira] [Commented] (SPARK-38017) Fix the API doc for window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481595#comment-17481595 ] Apache Spark commented on SPARK-38017: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-38016) Fix the API doc for session_window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-38016: --- Description: As of Spark 3.3.0, session_window supports not only TimestampType but also

[jira] [Updated] (SPARK-38017) Fix the API doc for window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-38017: --- Description: window function supports not only TimestampType but also TimestampNTZType but

[jira] [Created] (SPARK-38017) Fix the API doc for window to say it supports TimestampNTZType too as timeColumn

Kousuke Saruta created SPARK-38017: -- Summary: Fix the API doc for window to say it supports TimestampNTZType too as timeColumn Key: SPARK-38017 URL: https://issues.apache.org/jira/browse/SPARK-38017

[jira] [Commented] (SPARK-38016) Fix the API doc for session_window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481584#comment-17481584 ] Apache Spark commented on SPARK-38016: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38016) Fix the API doc for session_window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38016: Assignee: Kousuke Saruta (was: Apache Spark) > Fix the API doc for session_window to

[jira] [Commented] (SPARK-38016) Fix the API doc for session_window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481583#comment-17481583 ] Apache Spark commented on SPARK-38016: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38016) Fix the API doc for session_window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38016: Assignee: Apache Spark (was: Kousuke Saruta) > Fix the API doc for session_window to

[jira] [Assigned] (SPARK-38015) Mark legacy file naming functions as deprecated in FileCommitProtocol

[ https://issues.apache.org/jira/browse/SPARK-38015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38015: Assignee: Apache Spark > Mark legacy file naming functions as deprecated in

[jira] [Commented] (SPARK-38015) Mark legacy file naming functions as deprecated in FileCommitProtocol

[ https://issues.apache.org/jira/browse/SPARK-38015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481579#comment-17481579 ] Apache Spark commented on SPARK-38015: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38015) Mark legacy file naming functions as deprecated in FileCommitProtocol

[ https://issues.apache.org/jira/browse/SPARK-38015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38015: Assignee: (was: Apache Spark) > Mark legacy file naming functions as deprecated in

[jira] [Updated] (SPARK-38016) Fix the API doc for session_window to say it supports TimestampNTZType too as timeColumn

[ https://issues.apache.org/jira/browse/SPARK-38016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-38016: --- Summary: Fix the API doc for session_window to say it supports TimestampNTZType too as

[jira] [Updated] (SPARK-38016) Fix the API doc for session_window to say it supports TimestampNTZType too as timeColumn.

[ https://issues.apache.org/jira/browse/SPARK-38016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-38016: --- Summary: Fix the API doc for session_window to say it supports TimestampNTZType too as

[jira] [Created] (SPARK-38016) Fix the API doc for window and session_window to say it supports TimestampNTZType too as timeColumn.

Kousuke Saruta created SPARK-38016: -- Summary: Fix the API doc for window and session_window to say it supports TimestampNTZType too as timeColumn. Key: SPARK-38016 URL:

[jira] [Created] (SPARK-38015) Mark legacy file naming functions as deprecated in FileCommitProtocol

Cheng Su created SPARK-38015: Summary: Mark legacy file naming functions as deprecated in FileCommitProtocol Key: SPARK-38015 URL: https://issues.apache.org/jira/browse/SPARK-38015 Project: Spark

[jira] [Comment Edited] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481561#comment-17481561 ] Kapil Singh edited comment on SPARK-37995 at 1/25/22, 6:12 AM: --- Seems it

[jira] [Assigned] (SPARK-38014) Add Parquet Data Page V2 test scenario for BuiltInDataSourceWriteBenchmark

[ https://issues.apache.org/jira/browse/SPARK-38014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38014: Assignee: Apache Spark > Add Parquet Data Page V2 test scenario for

[jira] [Assigned] (SPARK-38014) Add Parquet Data Page V2 test scenario for BuiltInDataSourceWriteBenchmark

[ https://issues.apache.org/jira/browse/SPARK-38014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38014: Assignee: (was: Apache Spark) > Add Parquet Data Page V2 test scenario for

[jira] [Commented] (SPARK-38014) Add Parquet Data Page V2 test scenario for BuiltInDataSourceWriteBenchmark

[ https://issues.apache.org/jira/browse/SPARK-38014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481563#comment-17481563 ] Apache Spark commented on SPARK-38014: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481561#comment-17481561 ] Kapil Singh commented on SPARK-37995: - Seems it is related to this part of

[jira] [Updated] (SPARK-38013) Fix AQE can change bhj to smj if the build side is aggregate

[ https://issues.apache.org/jira/browse/SPARK-38013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38013: -- Description: (was: The condition of isBroadcastStage is not completed. It does not catch the plan

[jira] [Created] (SPARK-38014) Add Parquet Data Page V2 test scenario for BuiltInDataSourceWriteBenchmark

Yang Jie created SPARK-38014: Summary: Add Parquet Data Page V2 test scenario for BuiltInDataSourceWriteBenchmark Key: SPARK-38014 URL: https://issues.apache.org/jira/browse/SPARK-38014 Project: Spark

[jira] [Created] (SPARK-38013) Fix AQE can change bhj to smj if the build side is aggregate

XiDuo You created SPARK-38013: - Summary: Fix AQE can change bhj to smj if the build side is aggregate Key: SPARK-38013 URL: https://issues.apache.org/jira/browse/SPARK-38013 Project: Spark

[jira] [Assigned] (SPARK-36424) Support eliminate limits in AQE Optimizer

[ https://issues.apache.org/jira/browse/SPARK-36424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36424: --- Assignee: XiDuo You > Support eliminate limits in AQE Optimizer >

[jira] [Commented] (SPARK-38012) Rename `MEMORY_MODE` in `VectorizedParquetRecordReader` to `memoryMode`

[ https://issues.apache.org/jira/browse/SPARK-38012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481529#comment-17481529 ] Apache Spark commented on SPARK-38012: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38012) Rename `MEMORY_MODE` in `VectorizedParquetRecordReader` to `memoryMode`

[ https://issues.apache.org/jira/browse/SPARK-38012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38012: Assignee: Apache Spark > Rename `MEMORY_MODE` in `VectorizedParquetRecordReader` to

[jira] [Assigned] (SPARK-38012) Rename `MEMORY_MODE` in `VectorizedParquetRecordReader` to `memoryMode`

[ https://issues.apache.org/jira/browse/SPARK-38012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38012: Assignee: (was: Apache Spark) > Rename `MEMORY_MODE` in

[jira] [Created] (SPARK-38012) Rename `MEMORY_MODE` in `VectorizedParquetRecordReader` to `memoryMode`

Yang Jie created SPARK-38012: Summary: Rename `MEMORY_MODE` in `VectorizedParquetRecordReader` to `memoryMode` Key: SPARK-38012 URL: https://issues.apache.org/jira/browse/SPARK-38012 Project: Spark

[jira] [Commented] (SPARK-38011) Remove useless and duplicated configuration in ParquetFileFormat builderReader

[ https://issues.apache.org/jira/browse/SPARK-38011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481524#comment-17481524 ] Apache Spark commented on SPARK-38011: -- User 'Yikf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38011) Remove useless and duplicated configuration in ParquetFileFormat builderReader

[ https://issues.apache.org/jira/browse/SPARK-38011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38011: Assignee: (was: Apache Spark) > Remove useless and duplicated configuration in

[jira] [Assigned] (SPARK-38011) Remove useless and duplicated configuration in ParquetFileFormat builderReader

[ https://issues.apache.org/jira/browse/SPARK-38011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38011: Assignee: Apache Spark > Remove useless and duplicated configuration in

[jira] [Commented] (SPARK-37883) log4j update to 2.17.1 in spark-core 3.2

[ https://issues.apache.org/jira/browse/SPARK-37883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481521#comment-17481521 ] Hyukjin Kwon commented on SPARK-37883: -- Using log4j needs too much changes in Apache Spark, and we

[jira] [Created] (SPARK-38011) Remove useless and duplicated configuration in ParquetFileFormat builderReader

yikf created SPARK-38011: Summary: Remove useless and duplicated configuration in ParquetFileFormat builderReader Key: SPARK-38011 URL: https://issues.apache.org/jira/browse/SPARK-38011 Project: Spark

[jira] [Updated] (SPARK-38010) Push-based shuffle disabled due to insufficient mergeLocations

[ https://issues.apache.org/jira/browse/SPARK-38010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-38010: --- Parent: (was: SPARK-33235) Issue Type: Brainstorming (was: Technical task) >

[jira] [Updated] (SPARK-38010) Push-based shuffle disabled due to insufficient mergeLocations

[ https://issues.apache.org/jira/browse/SPARK-38010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-38010: --- Issue Type: Technical task (was: Sub-task) > Push-based shuffle disabled due to insufficient

[jira] [Updated] (SPARK-38010) Push-based shuffle disabled due to insufficient mergeLocations

[ https://issues.apache.org/jira/browse/SPARK-38010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-38010: --- Parent: SPARK-33235 Issue Type: Sub-task (was: Improvement) > Push-based shuffle disabled

[jira] [Updated] (SPARK-38010) Push-based shuffle disabled due to insufficient mergeLocations

[ https://issues.apache.org/jira/browse/SPARK-38010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-38010: --- Description: The current shuffle merger locations is obtained based on the host of the active or

[jira] [Created] (SPARK-38010) Push-based shuffle disabled due to insufficient mergeLocations

gaoyajun02 created SPARK-38010: -- Summary: Push-based shuffle disabled due to insufficient mergeLocations Key: SPARK-38010 URL: https://issues.apache.org/jira/browse/SPARK-38010 Project: Spark

[jira] [Resolved] (SPARK-38006) Clean up duplicated planner logic for window operator

[ https://issues.apache.org/jira/browse/SPARK-38006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38006. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35305

[jira] [Commented] (SPARK-37994) Unable to build spark3.2 with -Dhadoop.version=3.1.4

[ https://issues.apache.org/jira/browse/SPARK-37994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481507#comment-17481507 ] Vu Tan commented on SPARK-37994: [~xkrogen] Thank you for your comment ! [~csun]  Thank you for the

[jira] [Assigned] (SPARK-38008) Fix the method description of refill

[ https://issues.apache.org/jira/browse/SPARK-38008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38008: Assignee: Apache Spark > Fix the method description of refill >

[jira] [Assigned] (SPARK-38008) Fix the method description of refill

[ https://issues.apache.org/jira/browse/SPARK-38008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38008: Assignee: (was: Apache Spark) > Fix the method description of refill >

[jira] [Commented] (SPARK-38008) Fix the method description of refill

[ https://issues.apache.org/jira/browse/SPARK-38008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481498#comment-17481498 ] Apache Spark commented on SPARK-38008: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Updated] (SPARK-37998) Use `rbac.authorization.k8s.io/v1` instead of `v1beta1`

[ https://issues.apache.org/jira/browse/SPARK-37998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37998: -- Summary: Use `rbac.authorization.k8s.io/v1` instead of `v1beta1` (was: Failed to create rbac

[jira] [Resolved] (SPARK-37998) Failed to create rbac in latest kubernetes (minikube setup)

[ https://issues.apache.org/jira/browse/SPARK-37998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37998. --- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-37998) Failed to create rbac in latest kubernetes (minikube setup)

[ https://issues.apache.org/jira/browse/SPARK-37998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37998: - Assignee: Yikun Jiang > Failed to create rbac in latest kubernetes (minikube setup) >

[jira] [Updated] (SPARK-38008) Fix the method description of refill

[ https://issues.apache.org/jira/browse/SPARK-38008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-38008: - Description: Fix the method description of refill (was: Fix the description of refill method.)

[jira] [Commented] (SPARK-37883) log4j update to 2.17.1 in spark-core 3.2

[ https://issues.apache.org/jira/browse/SPARK-37883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481490#comment-17481490 ] Yue Ma commented on SPARK-37883: Hi [~hyukjin.kwon]  but considering the CVE-2019-17571

[jira] [Created] (SPARK-38009) In start-thriftserver.sh arguments, "--hiveconf xxx" should have higher precedence over "--conf spark.hadoop.xxx", or any other hadoop configurations

Peng Cheng created SPARK-38009: -- Summary: In start-thriftserver.sh arguments, "--hiveconf xxx" should have higher precedence over "--conf spark.hadoop.xxx", or any other hadoop configurations Key: SPARK-38009 URL:

[jira] [Created] (SPARK-38008) Fix the description of refill method

weixiuli created SPARK-38008: Summary: Fix the description of refill method Key: SPARK-38008 URL: https://issues.apache.org/jira/browse/SPARK-38008 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-38007) Update K8s doc to recommend K8s 1.20+

[ https://issues.apache.org/jira/browse/SPARK-38007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38007. --- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-38007) Update K8s doc to recommend K8s 1.20+

[ https://issues.apache.org/jira/browse/SPARK-38007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38007: - Assignee: Dongjoon Hyun > Update K8s doc to recommend K8s 1.20+ >

[jira] [Resolved] (SPARK-38002) Upgrade ZSTD-JNI to 1.5.2-1

[ https://issues.apache.org/jira/browse/SPARK-38002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38002. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35303

[jira] [Assigned] (SPARK-38002) Upgrade ZSTD-JNI to 1.5.2-1

[ https://issues.apache.org/jira/browse/SPARK-38002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38002: - Assignee: Dongjoon Hyun > Upgrade ZSTD-JNI to 1.5.2-1 > --- >

[jira] [Commented] (SPARK-38007) Update K8s doc to recommend K8s 1.20+

[ https://issues.apache.org/jira/browse/SPARK-38007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481474#comment-17481474 ] Apache Spark commented on SPARK-38007: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-38007) Update K8s doc to recommend K8s 1.20+

[ https://issues.apache.org/jira/browse/SPARK-38007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38007: Assignee: Apache Spark > Update K8s doc to recommend K8s 1.20+ >

[jira] [Assigned] (SPARK-38007) Update K8s doc to recommend K8s 1.20+

[ https://issues.apache.org/jira/browse/SPARK-38007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38007: Assignee: (was: Apache Spark) > Update K8s doc to recommend K8s 1.20+ >

[jira] [Created] (SPARK-38007) Update K8s doc to recommend K8s 1.20+

Dongjoon Hyun created SPARK-38007: - Summary: Update K8s doc to recommend K8s 1.20+ Key: SPARK-38007 URL: https://issues.apache.org/jira/browse/SPARK-38007 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-38006) Clean up duplicated planner logic for window operator

[ https://issues.apache.org/jira/browse/SPARK-38006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38006: Assignee: Apache Spark > Clean up duplicated planner logic for window operator >

[jira] [Assigned] (SPARK-38006) Clean up duplicated planner logic for window operator

[ https://issues.apache.org/jira/browse/SPARK-38006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38006: Assignee: Apache Spark > Clean up duplicated planner logic for window operator >

[jira] [Commented] (SPARK-38006) Clean up duplicated planner logic for window operator

[ https://issues.apache.org/jira/browse/SPARK-38006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481469#comment-17481469 ] Apache Spark commented on SPARK-38006: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38006) Clean up duplicated planner logic for window operator

[ https://issues.apache.org/jira/browse/SPARK-38006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38006: Assignee: (was: Apache Spark) > Clean up duplicated planner logic for window

[jira] [Created] (SPARK-38006) Clean up duplicated planner logic for window operator

Cheng Su created SPARK-38006: Summary: Clean up duplicated planner logic for window operator Key: SPARK-38006 URL: https://issues.apache.org/jira/browse/SPARK-38006 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38005) Support cleaning up merged shuffle files and state from external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-38005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-38005: -- Parent: SPARK-33235 Issue Type: Sub-task (was: Improvement) > Support cleaning up

[jira] [Updated] (SPARK-38005) Support cleaning up merged shuffle files and state from external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-38005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-38005: -- Description: Currently merged shuffle files and state is not cleaned up until an application

[jira] [Updated] (SPARK-38005) Support cleaning up merged shuffle files and state from external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-38005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated SPARK-38005: -- Description: Currently merged shuffle files and state is not cleaned up until an application

[jira] [Created] (SPARK-38005) Support cleaning up merged shuffle files and state from external shuffle service

Chandni Singh created SPARK-38005: - Summary: Support cleaning up merged shuffle files and state from external shuffle service Key: SPARK-38005 URL: https://issues.apache.org/jira/browse/SPARK-38005

[jira] [Resolved] (SPARK-37288) Backport update pyspark.since annotation to 3.1 and 3.2

[ https://issues.apache.org/jira/browse/SPARK-37288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37288. Assignee: Maciej Szymkiewicz Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-38004) read_excel's parameter - mangle_dupe_cols is used to handle duplicate columns but fails if the duplicate columns are case sensitive.

[ https://issues.apache.org/jira/browse/SPARK-38004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saikrishna Pujari updated SPARK-38004: -- Description: mangle_dupe_cols - default is True So ideally it should have handled

[jira] [Updated] (SPARK-38004) read_excel's parameter - mangle_dupe_cols is used to handle duplicate columns but fails if the duplicate columns are case sensitive.

[ https://issues.apache.org/jira/browse/SPARK-38004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saikrishna Pujari updated SPARK-38004: -- Description: mangle_dupe_cols - default is True So ideally it should have handled

[jira] [Created] (SPARK-38004) read_excel's parameter - mangle_dupe_cols is used to handle duplicate columns but fails if the duplicate columns are case sensitive.

Saikrishna Pujari created SPARK-38004: - Summary: read_excel's parameter - mangle_dupe_cols is used to handle duplicate columns but fails if the duplicate columns are case sensitive. Key: SPARK-38004 URL:

[jira] [Assigned] (SPARK-38003) Differentiate scalar and table function lookup in LookupFunctions

[ https://issues.apache.org/jira/browse/SPARK-38003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38003: Assignee: (was: Apache Spark) > Differentiate scalar and table function lookup in

[jira] [Commented] (SPARK-38003) Differentiate scalar and table function lookup in LookupFunctions

[ https://issues.apache.org/jira/browse/SPARK-38003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481449#comment-17481449 ] Apache Spark commented on SPARK-38003: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-38003) Differentiate scalar and table function lookup in LookupFunctions

[ https://issues.apache.org/jira/browse/SPARK-38003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38003: Assignee: Apache Spark > Differentiate scalar and table function lookup in

[jira] [Commented] (SPARK-38003) Differentiate scalar and table function lookup in LookupFunctions

[ https://issues.apache.org/jira/browse/SPARK-38003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481450#comment-17481450 ] Apache Spark commented on SPARK-38003: -- User 'allisonwang-db' has created a pull request for this

[jira] [Commented] (SPARK-38002) Upgrade ZSTD-JNI to 1.5.2-1

[ https://issues.apache.org/jira/browse/SPARK-38002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481445#comment-17481445 ] Apache Spark commented on SPARK-38002: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-38002) Upgrade ZSTD-JNI to 1.5.2-1

[ https://issues.apache.org/jira/browse/SPARK-38002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38002: Assignee: Apache Spark > Upgrade ZSTD-JNI to 1.5.2-1 > --- > >

[jira] [Assigned] (SPARK-38002) Upgrade ZSTD-JNI to 1.5.2-1

[ https://issues.apache.org/jira/browse/SPARK-38002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38002: Assignee: (was: Apache Spark) > Upgrade ZSTD-JNI to 1.5.2-1 >

[jira] [Created] (SPARK-38003) Differentiate scalar and table function lookup in LookupFunctions

Allison Wang created SPARK-38003: Summary: Differentiate scalar and table function lookup in LookupFunctions Key: SPARK-38003 URL: https://issues.apache.org/jira/browse/SPARK-38003 Project: Spark

[jira] [Created] (SPARK-38002) Upgrade ZSTD-JNI to 1.5.2-1

Dongjoon Hyun created SPARK-38002: - Summary: Upgrade ZSTD-JNI to 1.5.2-1 Key: SPARK-38002 URL: https://issues.apache.org/jira/browse/SPARK-38002 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34372) Speculation results in broken CSV files in Amazon S3

[ https://issues.apache.org/jira/browse/SPARK-34372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481414#comment-17481414 ] Daehee Han commented on SPARK-34372: Hi Atilla, we've been disabled the speculation since this issue

[jira] [Commented] (SPARK-38000) Sort node incorrectly removed from the optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-38000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481392#comment-17481392 ] Bruce Robbins commented on SPARK-38000: --- I can reproduce on 3.2.0, but it seems to be fixed on

[jira] [Commented] (SPARK-37891) Add scalastyle check to disable scala.concurrent.ExecutionContext.Implicits.global

[ https://issues.apache.org/jira/browse/SPARK-37891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481370#comment-17481370 ] Xingbo Jiang commented on SPARK-37891: -- Issue resolved by pull request:

[jira] [Resolved] (SPARK-37891) Add scalastyle check to disable scala.concurrent.ExecutionContext.Implicits.global

[ https://issues.apache.org/jira/browse/SPARK-37891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-37891. -- Assignee: Tianhan Hu Resolution: Fixed > Add scalastyle check to disable >

[jira] [Commented] (SPARK-37994) Unable to build spark3.2 with -Dhadoop.version=3.1.4

[ https://issues.apache.org/jira/browse/SPARK-37994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481327#comment-17481327 ] Chao Sun commented on SPARK-37994: -- I considered to add a new Maven profile for Hadoop versions <= 2.x

[jira] [Commented] (SPARK-37994) Unable to build spark3.2 with -Dhadoop.version=3.1.4

[ https://issues.apache.org/jira/browse/SPARK-37994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481326#comment-17481326 ] Chao Sun commented on SPARK-37994: -- Yes, thanks [~xkrogen] for pinging me. [~tanvu]: can you try this

[jira] [Commented] (SPARK-37994) Unable to build spark3.2 with -Dhadoop.version=3.1.4

[ https://issues.apache.org/jira/browse/SPARK-37994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481318#comment-17481318 ] Erik Krogen commented on SPARK-37994: - cc [~csun]  – is this related to your changes for using the

[jira] [Commented] (SPARK-38001) Replace the unsupported error classes by `UNSUPPORTED_FEATURE`

[ https://issues.apache.org/jira/browse/SPARK-38001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481285#comment-17481285 ] Apache Spark commented on SPARK-38001: -- User 'MaxGekk' has created a pull request for this issue:

  1   2   >