[jira] [Assigned] (SPARK-39037) DS V2 aggregate push-down supports order by expressions

[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39037: Assignee: Apache Spark > DS V2 aggregate push-down supports order by expressions > --

[jira] [Assigned] (SPARK-39037) DS V2 aggregate push-down supports order by expressions

[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39037: Assignee: (was: Apache Spark) > DS V2 aggregate push-down supports order by expressio

[jira] [Commented] (SPARK-39037) DS V2 aggregate push-down supports order by expressions

[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528585#comment-17528585 ] Apache Spark commented on SPARK-39037: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-39037) DS V2 aggregate push-down supports order by expressions

[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528584#comment-17528584 ] Apache Spark commented on SPARK-39037: -- User 'beliefer' has created a pull request

[jira] [Resolved] (SPARK-38918) Nested column pruning should filter out attributes that do not belong to the current relation

[ https://issues.apache.org/jira/browse/SPARK-38918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-38918. - Fix Version/s: 3.3.0 3.4.0 Assignee: Allison Wang Resolution:

[jira] [Created] (SPARK-39037) DS V2 aggregate push-down supports order by expressions

jiaan.geng created SPARK-39037: -- Summary: DS V2 aggregate push-down supports order by expressions Key: SPARK-39037 URL: https://issues.apache.org/jira/browse/SPARK-39037 Project: Spark Issue Typ

[jira] [Created] (SPARK-39036) support Alter Table/Partition Concatenate command

gabrywu created SPARK-39036: --- Summary: support Alter Table/Partition Concatenate command Key: SPARK-39036 URL: https://issues.apache.org/jira/browse/SPARK-39036 Project: Spark Issue Type: New Featu

[jira] [Updated] (SPARK-38976) spark-sql. overwrite. hive table-duplicate records

[ https://issues.apache.org/jira/browse/SPARK-38976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wesharn updated SPARK-38976: Description: It occured duplicate records when spark-sql overwrite hive table . when spark job has failur

[jira] [Resolved] (SPARK-39002) StringEndsWith/Contains support push down to Parquet so that we can leverage dictionary filter

[ https://issues.apache.org/jira/browse/SPARK-39002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-39002. - Fix Version/s: 3.4.0 Assignee: EdisonWang Resolution: Fixed > StringEndsWith/Con

[jira] [Commented] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528530#comment-17528530 ] Apache Spark commented on SPARK-39032: -- User 'vadim' has created a pull request for

[jira] [Assigned] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39032: Assignee: (was: Apache Spark) > Incorrectly formatted examples in pyspark.sql.functio

[jira] [Commented] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528529#comment-17528529 ] Apache Spark commented on SPARK-39032: -- User 'vadim' has created a pull request for

[jira] [Assigned] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39032: Assignee: Apache Spark > Incorrectly formatted examples in pyspark.sql.functions.when > -

[jira] [Commented] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528528#comment-17528528 ] Haejoon Lee commented on SPARK-39034: - I'm working on this > Add tests for options

[jira] [Created] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

Haejoon Lee created SPARK-39035: --- Summary: Add tests for options from `to_csv` and `from_csv`. Key: SPARK-39035 URL: https://issues.apache.org/jira/browse/SPARK-39035 Project: Spark Issue Type:

[jira] [Created] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

Haejoon Lee created SPARK-39034: --- Summary: Add tests for options from `to_json` and `from_json`. Key: SPARK-39034 URL: https://issues.apache.org/jira/browse/SPARK-39034 Project: Spark Issue Typ

[jira] [Created] (SPARK-39033) Support --proxy-user for Spark on K8s not working

jagadeesh created SPARK-39033: - Summary: Support --proxy-user for Spark on K8s not working Key: SPARK-39033 URL: https://issues.apache.org/jira/browse/SPARK-39033 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39027. --- Fix Version/s: (was: 3.4.0) Resolution: Fixed Issue resolved by pull request 3636

[jira] [Updated] (SPARK-39020) [CVE-2020-9480] Transitive dependency "unused" from spark-sql_2.12 highlight as vulnerable in dependency tracker

[ https://issues.apache.org/jira/browse/SPARK-39020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39020: - Shepherd: (was: Patrick Wendell) > [CVE-2020-9480] Transitive dependency "unused" from spark

[jira] [Updated] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39032: - Issue Type: Documentation (was: Bug) > Incorrectly formatted examples in pyspark.sql.functions.

[jira] [Updated] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39032: - Priority: Minor (was: Major) > Incorrectly formatted examples in pyspark.sql.functions.when > -

[jira] [Commented] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528522#comment-17528522 ] Hyukjin Kwon commented on SPARK-39032: -- Oops, [~vadim.patsalo] interested in submit

[jira] [Resolved] (SPARK-38985) Support sub-error-class for UNSUPPORTED_FEATURE et al

[ https://issues.apache.org/jira/browse/SPARK-38985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38985. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36307 [https://gith

[jira] [Assigned] (SPARK-38985) Support sub-error-class for UNSUPPORTED_FEATURE et al

[ https://issues.apache.org/jira/browse/SPARK-38985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38985: --- Assignee: Serge Rielau > Support sub-error-class for UNSUPPORTED_FEATURE et al > --

[jira] [Resolved] (SPARK-38907) Impl DataFrame.corrwith

[ https://issues.apache.org/jira/browse/SPARK-38907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38907. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36205 [https://gi

[jira] [Assigned] (SPARK-38907) Impl DataFrame.corrwith

[ https://issues.apache.org/jira/browse/SPARK-38907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38907: Assignee: zhengruifeng > Impl DataFrame.corrwith > --- > >

[jira] [Resolved] (SPARK-38970) Skip build-and-test workflow on forks when scheduled

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38970. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36285 [https://gi

[jira] [Resolved] (SPARK-39000) Convert bools to ints in basic statistical functions of GroupBy objects

[ https://issues.apache.org/jira/browse/SPARK-39000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39000. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36309 [https://gi

[jira] [Assigned] (SPARK-39000) Convert bools to ints in basic statistical functions of GroupBy objects

[ https://issues.apache.org/jira/browse/SPARK-39000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39000: Assignee: Xinrong Meng > Convert bools to ints in basic statistical functions of GroupBy

[jira] [Assigned] (SPARK-38970) Skip build-and-test workflow on forks when scheduled

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38970: Assignee: Enrico Minack > Skip build-and-test workflow on forks when scheduled >

[jira] [Resolved] (SPARK-38879) Improve the test coverage for pyspark/rddsampler.py

[ https://issues.apache.org/jira/browse/SPARK-38879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38879. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36342 [https://gi

[jira] [Assigned] (SPARK-38879) Improve the test coverage for pyspark/rddsampler.py

[ https://issues.apache.org/jira/browse/SPARK-38879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38879: Assignee: pralabhkumar > Improve the test coverage for pyspark/rddsampler.py > --

[jira] [Assigned] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39030: Assignee: Bjørn Jørgensen > Remame sum > -- > > Key: SPARK-39030

[jira] [Resolved] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39030. -- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-38354) Add hash probes metrics for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38354: Assignee: (was: Apache Spark) > Add hash probes metrics for shuffled hash join >

[jira] [Assigned] (SPARK-38354) Add hash probes metrics for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38354: Assignee: Apache Spark > Add hash probes metrics for shuffled hash join > ---

[jira] [Commented] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed many times.

[ https://issues.apache.org/jira/browse/SPARK-38988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528459#comment-17528459 ] Xinrong Meng commented on SPARK-38988: -- Thank you for raising that! I will try mut

[jira] [Commented] (SPARK-34863) Support nested column in Spark Parquet vectorized readers

[ https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528454#comment-17528454 ] Apache Spark commented on SPARK-34863: -- User 'sadikovi' has created a pull request

[jira] [Commented] (SPARK-34863) Support nested column in Spark Parquet vectorized readers

[ https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528453#comment-17528453 ] Apache Spark commented on SPARK-34863: -- User 'sadikovi' has created a pull request

[jira] [Resolved] (SPARK-39006) Check PVC claimName must be OnDemand when multiple executor required

[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39006. --- Fix Version/s: (was: 3.4.0) Resolution: Invalid > Check PVC claimName must be OnD

[jira] [Commented] (SPARK-39006) Check PVC claimName must be OnDemand when multiple executor required

[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528450#comment-17528450 ] Dongjoon Hyun commented on SPARK-39006: --- As I commented on the PR, I'm -1 for this

[jira] [Updated] (SPARK-32461) Shuffled hash join improvement

[ https://issues.apache.org/jira/browse/SPARK-32461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32461: -- Target Version/s: (was: 3.2.0) > Shuffled hash join improvement > --

[jira] [Updated] (SPARK-38354) Add hash probes metrics for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38354: -- Fix Version/s: (was: 3.3.0) > Add hash probes metrics for shuffled hash join > ---

[jira] [Reopened] (SPARK-38354) Add hash probes metrics for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-38354: --- Assignee: (was: Cheng Su) This is reverted due to the regression via https://github.c

[jira] [Updated] (SPARK-39019) Refactor `SPARK-37463: read/write Timestamp ntz to Orc with different time zone` to use `TempPath`

[ https://issues.apache.org/jira/browse/SPARK-39019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39019: -- Affects Version/s: 3.3.0 (was: 3.4.0) > Refactor `SPARK-37463: read

[jira] [Updated] (SPARK-39019) Use `withTempPath` to clean up temporary data directory after `SPARK-37463: read/write Timestamp ntz to Orc with different time zone`

[ https://issues.apache.org/jira/browse/SPARK-39019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39019: -- Summary: Use `withTempPath` to clean up temporary data directory after `SPARK-37463: read/writ

[jira] [Resolved] (SPARK-39019) Refactor `SPARK-37463: read/write Timestamp ntz to Orc with different time zone` to use `TempPath`

[ https://issues.apache.org/jira/browse/SPARK-39019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39019. --- Fix Version/s: 3.3.0 Assignee: Yang Jie Resolution: Fixed This is resolved v

[jira] [Updated] (SPARK-39019) Refactor `SPARK-37463: read/write Timestamp ntz to Orc with different time zone` to use `TempPath`

[ https://issues.apache.org/jira/browse/SPARK-39019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39019: -- Issue Type: Test (was: Improvement) > Refactor `SPARK-37463: read/write Timestamp ntz to Orc

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528436#comment-17528436 ] Dongjoon Hyun commented on SPARK-39025: --- AFAIK, this claim is wrong because we alr

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528434#comment-17528434 ] Dongjoon Hyun commented on SPARK-39025: --- +1 for [~hyukjin.kwon]'s explanation. BTW

[jira] [Updated] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39025: -- Fix Version/s: (was: 3.4.0) > Add k8s Scheduling, Preemption and Eviction feature to apach

[jira] [Commented] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528418#comment-17528418 ] Apache Spark commented on SPARK-28516: -- User 'dtenedor' has created a pull request

[jira] [Updated] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim Patsalo updated SPARK-39032: -- Description: Missing `Examples\n`.     was: Missing `Examples\n`.   !im

[jira] [Updated] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim Patsalo updated SPARK-39032: -- Attachment: Screen Shot 2022-04-26 at 14.06.47.png > Incorrectly formatted examples in pyspark

[jira] [Created] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

Vadim Patsalo created SPARK-39032: - Summary: Incorrectly formatted examples in pyspark.sql.functions.when Key: SPARK-39032 URL: https://issues.apache.org/jira/browse/SPARK-39032 Project: Spark

[jira] [Created] (SPARK-39031) NaN != NaN in pivot

Robert Joseph Evans created SPARK-39031: --- Summary: NaN != NaN in pivot Key: SPARK-39031 URL: https://issues.apache.org/jira/browse/SPARK-39031 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528397#comment-17528397 ] Apache Spark commented on SPARK-39030: -- User 'bjornjorgensen' has created a pull re

[jira] [Assigned] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39030: Assignee: (was: Apache Spark) > Remame sum > -- > > Key: SPAR

[jira] [Assigned] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39030: Assignee: Apache Spark > Remame sum > -- > > Key: SPARK-39030 >

[jira] [Commented] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528396#comment-17528396 ] Apache Spark commented on SPARK-39030: -- User 'bjornjorgensen' has created a pull re

[jira] [Created] (SPARK-39030) Remame sum

Bjørn Jørgensen created SPARK-39030: --- Summary: Remame sum Key: SPARK-39030 URL: https://issues.apache.org/jira/browse/SPARK-39030 Project: Spark Issue Type: Improvement Components

[jira] [Resolved] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39028. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36362 [https://github.com

[jira] [Commented] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528350#comment-17528350 ] Apache Spark commented on SPARK-39027: -- User 'MaxGekk' has created a pull request f

[jira] [Resolved] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39016. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36349 [https://gi

[jira] [Assigned] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39016: Assignee: Yang Jie > Fix compilation warnings related to "`enum` will become a keyword in

[jira] [Commented] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528275#comment-17528275 ] Apache Spark commented on SPARK-39016: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528274#comment-17528274 ] Apache Spark commented on SPARK-39016: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39016: Assignee: Apache Spark > Fix compilation warnings related to "`enum` will become a keywor

[jira] [Assigned] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39016: Assignee: (was: Apache Spark) > Fix compilation warnings related to "`enum` will beco

[jira] [Commented] (SPARK-39029) Improve the test coverage for pyspark/broadcast.py

[ https://issues.apache.org/jira/browse/SPARK-39029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528269#comment-17528269 ] pralabhkumar commented on SPARK-39029: -- I am working on this .  > Improve the test

[jira] [Created] (SPARK-39029) Improve the test coverage for pyspark/broadcast.py

pralabhkumar created SPARK-39029: Summary: Improve the test coverage for pyspark/broadcast.py Key: SPARK-39029 URL: https://issues.apache.org/jira/browse/SPARK-39029 Project: Spark Issue Type

[jira] [Assigned] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39028: Assignee: Gengliang Wang (was: Apache Spark) > Use SparkDateTimeException when casting t

[jira] [Commented] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528258#comment-17528258 ] Apache Spark commented on SPARK-39028: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39028: Assignee: Apache Spark (was: Gengliang Wang) > Use SparkDateTimeException when casting t

[jira] [Commented] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528257#comment-17528257 ] Apache Spark commented on SPARK-39028: -- User 'gengliangwang' has created a pull req

[jira] [Comment Edited] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528233#comment-17528233 ] Nicholas Chammas edited comment on SPARK-37222 at 4/26/22 3:44 PM: ---

[jira] [Created] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

Gengliang Wang created SPARK-39028: -- Summary: Use SparkDateTimeException when casting to datetime types failed Key: SPARK-39028 URL: https://issues.apache.org/jira/browse/SPARK-39028 Project: Spark

[jira] [Commented] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528233#comment-17528233 ] Nicholas Chammas commented on SPARK-37222: -- I've found a helpful log setting th

[jira] [Updated] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-37222: - Attachment: plan-log.log > Max iterations reached in Operator Optimization w/left_anti o

[jira] [Resolved] (SPARK-38944) Close `NioBufferedFileInputStream` opened by `ExternalAppendOnlyUnsafeRowArraySuite`

[ https://issues.apache.org/jira/browse/SPARK-38944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38944. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36262 [https://gi

[jira] [Assigned] (SPARK-38944) Close `NioBufferedFileInputStream` opened by `ExternalAppendOnlyUnsafeRowArraySuite`

[ https://issues.apache.org/jira/browse/SPARK-38944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38944: Assignee: Yang Jie > Close `NioBufferedFileInputStream` opened by > `ExternalAppendOnlyU

[jira] [Commented] (SPARK-34079) Merge non-correlated scalar subqueries

[ https://issues.apache.org/jira/browse/SPARK-34079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528164#comment-17528164 ] Apache Spark commented on SPARK-34079: -- User 'peter-toth' has created a pull reques

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528141#comment-17528141 ] Apache Spark commented on SPARK-39025: -- User 'dcoliversun' has created a pull reque

[jira] [Assigned] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39025: Assignee: Apache Spark > Add k8s Scheduling, Preemption and Eviction feature to apache sp

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528142#comment-17528142 ] Apache Spark commented on SPARK-39025: -- User 'dcoliversun' has created a pull reque

[jira] [Assigned] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39025: Assignee: (was: Apache Spark) > Add k8s Scheduling, Preemption and Eviction feature t

[jira] [Assigned] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39027: Assignee: Max Gekk (was: Apache Spark) > Output SQL statements in upper case in error me

[jira] [Assigned] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39027: Assignee: Apache Spark (was: Max Gekk) > Output SQL statements in upper case in error me

[jira] [Commented] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528089#comment-17528089 ] Apache Spark commented on SPARK-39027: -- User 'MaxGekk' has created a pull request f

[jira] [Updated] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39027: - Description: Output SQL statements in upper case ONLY in error messages. For example, the error message

[jira] [Created] (SPARK-39027) Output SQL statements in upper case in error messages

Max Gekk created SPARK-39027: Summary: Output SQL statements in upper case in error messages Key: SPARK-39027 URL: https://issues.apache.org/jira/browse/SPARK-39027 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528088#comment-17528088 ] Hyukjin Kwon commented on SPARK-39025: -- You don't have to be assigned. Once you ope

[jira] [Assigned] (SPARK-39026) Add k8s tolerations support for apache spark

[ https://issues.apache.org/jira/browse/SPARK-39026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39026: Assignee: Apache Spark > Add k8s tolerations support for apache spark > -

[jira] [Assigned] (SPARK-39026) Add k8s tolerations support for apache spark

[ https://issues.apache.org/jira/browse/SPARK-39026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39026: Assignee: (was: Apache Spark) > Add k8s tolerations support for apache spark > --

[jira] [Commented] (SPARK-39026) Add k8s tolerations support for apache spark

[ https://issues.apache.org/jira/browse/SPARK-39026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528087#comment-17528087 ] Apache Spark commented on SPARK-39026: -- User 'dcoliversun' has created a pull reque

[jira] [Created] (SPARK-39026) Add k8s tolerations support for apache spark

qian created SPARK-39026: Summary: Add k8s tolerations support for apache spark Key: SPARK-39026 URL: https://issues.apache.org/jira/browse/SPARK-39026 Project: Spark Issue Type: Sub-task C

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528081#comment-17528081 ] qian commented on SPARK-39025: -- I am working on this. Please assign to me [~dongjoon]  [~hy

[jira] [Created] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

qian created SPARK-39025: Summary: Add k8s Scheduling, Preemption and Eviction feature to apache spark Key: SPARK-39025 URL: https://issues.apache.org/jira/browse/SPARK-39025 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-38821) test_nsmallest test failed tue to pandas 1.4.0-1.4.2 bug

[ https://issues.apache.org/jira/browse/SPARK-38821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38821. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36356 [https://gi

[jira] [Assigned] (SPARK-38821) test_nsmallest test failed tue to pandas 1.4.0-1.4.2 bug

[ https://issues.apache.org/jira/browse/SPARK-38821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38821: Assignee: Yikun Jiang > test_nsmallest test failed tue to pandas 1.4.0-1.4.2 bug > --

  1   2   >