[jira] [Resolved] (SPARK-39002) StringEndsWith/Contains support push down to Parquet so that we can leverage dictionary filter

[ https://issues.apache.org/jira/browse/SPARK-39002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-39002. - Fix Version/s: 3.4.0 Assignee: EdisonWang Resolution: Fixed >

[jira] [Commented] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528530#comment-17528530 ] Apache Spark commented on SPARK-39032: -- User 'vadim' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39032: Assignee: (was: Apache Spark) > Incorrectly formatted examples in

[jira] [Commented] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528529#comment-17528529 ] Apache Spark commented on SPARK-39032: -- User 'vadim' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39032: Assignee: Apache Spark > Incorrectly formatted examples in pyspark.sql.functions.when >

[jira] [Commented] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528528#comment-17528528 ] Haejoon Lee commented on SPARK-39034: - I'm working on this > Add tests for options from `to_json`

[jira] [Created] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

Haejoon Lee created SPARK-39035: --- Summary: Add tests for options from `to_csv` and `from_csv`. Key: SPARK-39035 URL: https://issues.apache.org/jira/browse/SPARK-39035 Project: Spark Issue

[jira] [Created] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

Haejoon Lee created SPARK-39034: --- Summary: Add tests for options from `to_json` and `from_json`. Key: SPARK-39034 URL: https://issues.apache.org/jira/browse/SPARK-39034 Project: Spark Issue

[jira] [Created] (SPARK-39033) Support --proxy-user for Spark on K8s not working

jagadeesh created SPARK-39033: - Summary: Support --proxy-user for Spark on K8s not working Key: SPARK-39033 URL: https://issues.apache.org/jira/browse/SPARK-39033 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39027. --- Fix Version/s: (was: 3.4.0) Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-39020) [CVE-2020-9480] Transitive dependency "unused" from spark-sql_2.12 highlight as vulnerable in dependency tracker

[ https://issues.apache.org/jira/browse/SPARK-39020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39020: - Shepherd: (was: Patrick Wendell) > [CVE-2020-9480] Transitive dependency "unused" from

[jira] [Updated] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39032: - Issue Type: Documentation (was: Bug) > Incorrectly formatted examples in

[jira] [Updated] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39032: - Priority: Minor (was: Major) > Incorrectly formatted examples in pyspark.sql.functions.when >

[jira] [Commented] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528522#comment-17528522 ] Hyukjin Kwon commented on SPARK-39032: -- Oops, [~vadim.patsalo] interested in submitting a PR? >

[jira] [Resolved] (SPARK-38985) Support sub-error-class for UNSUPPORTED_FEATURE et al

[ https://issues.apache.org/jira/browse/SPARK-38985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38985. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36307

[jira] [Assigned] (SPARK-38985) Support sub-error-class for UNSUPPORTED_FEATURE et al

[ https://issues.apache.org/jira/browse/SPARK-38985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38985: --- Assignee: Serge Rielau > Support sub-error-class for UNSUPPORTED_FEATURE et al >

[jira] [Resolved] (SPARK-38907) Impl DataFrame.corrwith

[ https://issues.apache.org/jira/browse/SPARK-38907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38907. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36205

[jira] [Assigned] (SPARK-38907) Impl DataFrame.corrwith

[ https://issues.apache.org/jira/browse/SPARK-38907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38907: Assignee: zhengruifeng > Impl DataFrame.corrwith > --- > >

[jira] [Resolved] (SPARK-38970) Skip build-and-test workflow on forks when scheduled

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38970. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36285

[jira] [Resolved] (SPARK-39000) Convert bools to ints in basic statistical functions of GroupBy objects

[ https://issues.apache.org/jira/browse/SPARK-39000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39000. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36309

[jira] [Assigned] (SPARK-39000) Convert bools to ints in basic statistical functions of GroupBy objects

[ https://issues.apache.org/jira/browse/SPARK-39000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39000: Assignee: Xinrong Meng > Convert bools to ints in basic statistical functions of GroupBy

[jira] [Assigned] (SPARK-38970) Skip build-and-test workflow on forks when scheduled

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38970: Assignee: Enrico Minack > Skip build-and-test workflow on forks when scheduled >

[jira] [Resolved] (SPARK-38879) Improve the test coverage for pyspark/rddsampler.py

[ https://issues.apache.org/jira/browse/SPARK-38879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38879. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36342

[jira] [Assigned] (SPARK-38879) Improve the test coverage for pyspark/rddsampler.py

[ https://issues.apache.org/jira/browse/SPARK-38879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38879: Assignee: pralabhkumar > Improve the test coverage for pyspark/rddsampler.py >

[jira] [Assigned] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39030: Assignee: Bjørn Jørgensen > Remame sum > -- > > Key: SPARK-39030

[jira] [Resolved] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39030. -- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-38354) Add hash probes metrics for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38354: Assignee: (was: Apache Spark) > Add hash probes metrics for shuffled hash join >

[jira] [Assigned] (SPARK-38354) Add hash probes metrics for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38354: Assignee: Apache Spark > Add hash probes metrics for shuffled hash join >

[jira] [Commented] (SPARK-38988) Pandas API - "PerformanceWarning: DataFrame is highly fragmented." get printed many times.

[ https://issues.apache.org/jira/browse/SPARK-38988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528459#comment-17528459 ] Xinrong Meng commented on SPARK-38988: -- Thank you for raising that! I will try muting the warnings

[jira] [Commented] (SPARK-34863) Support nested column in Spark Parquet vectorized readers

[ https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528454#comment-17528454 ] Apache Spark commented on SPARK-34863: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Commented] (SPARK-34863) Support nested column in Spark Parquet vectorized readers

[ https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528453#comment-17528453 ] Apache Spark commented on SPARK-34863: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Resolved] (SPARK-39006) Check PVC claimName must be OnDemand when multiple executor required

[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39006. --- Fix Version/s: (was: 3.4.0) Resolution: Invalid > Check PVC claimName must be

[jira] [Commented] (SPARK-39006) Check PVC claimName must be OnDemand when multiple executor required

[ https://issues.apache.org/jira/browse/SPARK-39006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528450#comment-17528450 ] Dongjoon Hyun commented on SPARK-39006: --- As I commented on the PR, I'm -1 for this proposal

[jira] [Updated] (SPARK-32461) Shuffled hash join improvement

[ https://issues.apache.org/jira/browse/SPARK-32461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32461: -- Target Version/s: (was: 3.2.0) > Shuffled hash join improvement >

[jira] [Updated] (SPARK-38354) Add hash probes metrics for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38354: -- Fix Version/s: (was: 3.3.0) > Add hash probes metrics for shuffled hash join >

[jira] [Reopened] (SPARK-38354) Add hash probes metrics for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-38354: --- Assignee: (was: Cheng Su) This is reverted due to the regression via

[jira] [Updated] (SPARK-39019) Refactor `SPARK-37463: read/write Timestamp ntz to Orc with different time zone` to use `TempPath`

[ https://issues.apache.org/jira/browse/SPARK-39019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39019: -- Affects Version/s: 3.3.0 (was: 3.4.0) > Refactor `SPARK-37463:

[jira] [Updated] (SPARK-39019) Use `withTempPath` to clean up temporary data directory after `SPARK-37463: read/write Timestamp ntz to Orc with different time zone`

[ https://issues.apache.org/jira/browse/SPARK-39019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39019: -- Summary: Use `withTempPath` to clean up temporary data directory after `SPARK-37463:

[jira] [Resolved] (SPARK-39019) Refactor `SPARK-37463: read/write Timestamp ntz to Orc with different time zone` to use `TempPath`

[ https://issues.apache.org/jira/browse/SPARK-39019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39019. --- Fix Version/s: 3.3.0 Assignee: Yang Jie Resolution: Fixed This is resolved

[jira] [Updated] (SPARK-39019) Refactor `SPARK-37463: read/write Timestamp ntz to Orc with different time zone` to use `TempPath`

[ https://issues.apache.org/jira/browse/SPARK-39019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39019: -- Issue Type: Test (was: Improvement) > Refactor `SPARK-37463: read/write Timestamp ntz to Orc

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528436#comment-17528436 ] Dongjoon Hyun commented on SPARK-39025: --- AFAIK, this claim is wrong because we already support it

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528434#comment-17528434 ] Dongjoon Hyun commented on SPARK-39025: --- +1 for [~hyukjin.kwon]'s explanation. BTW,

[jira] [Updated] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39025: -- Fix Version/s: (was: 3.4.0) > Add k8s Scheduling, Preemption and Eviction feature to

[jira] [Commented] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528418#comment-17528418 ] Apache Spark commented on SPARK-28516: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Updated] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim Patsalo updated SPARK-39032: -- Description: Missing `Examples\n`.     was: Missing `Examples\n`.  

[jira] [Updated] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

[ https://issues.apache.org/jira/browse/SPARK-39032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim Patsalo updated SPARK-39032: -- Attachment: Screen Shot 2022-04-26 at 14.06.47.png > Incorrectly formatted examples in

[jira] [Created] (SPARK-39032) Incorrectly formatted examples in pyspark.sql.functions.when

Vadim Patsalo created SPARK-39032: - Summary: Incorrectly formatted examples in pyspark.sql.functions.when Key: SPARK-39032 URL: https://issues.apache.org/jira/browse/SPARK-39032 Project: Spark

[jira] [Created] (SPARK-39031) NaN != NaN in pivot

Robert Joseph Evans created SPARK-39031: --- Summary: NaN != NaN in pivot Key: SPARK-39031 URL: https://issues.apache.org/jira/browse/SPARK-39031 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528397#comment-17528397 ] Apache Spark commented on SPARK-39030: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Assigned] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39030: Assignee: (was: Apache Spark) > Remame sum > -- > > Key:

[jira] [Assigned] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39030: Assignee: Apache Spark > Remame sum > -- > > Key: SPARK-39030 >

[jira] [Commented] (SPARK-39030) Remame sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528396#comment-17528396 ] Apache Spark commented on SPARK-39030: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Created] (SPARK-39030) Remame sum

Bjørn Jørgensen created SPARK-39030: --- Summary: Remame sum Key: SPARK-39030 URL: https://issues.apache.org/jira/browse/SPARK-39030 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39028. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36362

[jira] [Commented] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528350#comment-17528350 ] Apache Spark commented on SPARK-39027: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39016. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36349

[jira] [Assigned] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39016: Assignee: Yang Jie > Fix compilation warnings related to "`enum` will become a keyword

[jira] [Commented] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528275#comment-17528275 ] Apache Spark commented on SPARK-39016: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528274#comment-17528274 ] Apache Spark commented on SPARK-39016: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39016: Assignee: Apache Spark > Fix compilation warnings related to "`enum` will become a

[jira] [Assigned] (SPARK-39016) Fix compilation warnings related to "`enum` will become a keyword in Scala 3"

[ https://issues.apache.org/jira/browse/SPARK-39016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39016: Assignee: (was: Apache Spark) > Fix compilation warnings related to "`enum` will

[jira] [Commented] (SPARK-39029) Improve the test coverage for pyspark/broadcast.py

[ https://issues.apache.org/jira/browse/SPARK-39029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528269#comment-17528269 ] pralabhkumar commented on SPARK-39029: -- I am working on this .  > Improve the test coverage for

[jira] [Created] (SPARK-39029) Improve the test coverage for pyspark/broadcast.py

pralabhkumar created SPARK-39029: Summary: Improve the test coverage for pyspark/broadcast.py Key: SPARK-39029 URL: https://issues.apache.org/jira/browse/SPARK-39029 Project: Spark Issue

[jira] [Assigned] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39028: Assignee: Gengliang Wang (was: Apache Spark) > Use SparkDateTimeException when casting

[jira] [Commented] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528258#comment-17528258 ] Apache Spark commented on SPARK-39028: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39028: Assignee: Apache Spark (was: Gengliang Wang) > Use SparkDateTimeException when casting

[jira] [Commented] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

[ https://issues.apache.org/jira/browse/SPARK-39028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528257#comment-17528257 ] Apache Spark commented on SPARK-39028: -- User 'gengliangwang' has created a pull request for this

[jira] [Comment Edited] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528233#comment-17528233 ] Nicholas Chammas edited comment on SPARK-37222 at 4/26/22 3:44 PM: ---

[jira] [Created] (SPARK-39028) Use SparkDateTimeException when casting to datetime types failed

Gengliang Wang created SPARK-39028: -- Summary: Use SparkDateTimeException when casting to datetime types failed Key: SPARK-39028 URL: https://issues.apache.org/jira/browse/SPARK-39028 Project: Spark

[jira] [Commented] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528233#comment-17528233 ] Nicholas Chammas commented on SPARK-37222: -- I've found a helpful log setting that causes Spark

[jira] [Updated] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-37222: - Attachment: plan-log.log > Max iterations reached in Operator Optimization w/left_anti

[jira] [Resolved] (SPARK-38944) Close `NioBufferedFileInputStream` opened by `ExternalAppendOnlyUnsafeRowArraySuite`

[ https://issues.apache.org/jira/browse/SPARK-38944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38944. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36262

[jira] [Assigned] (SPARK-38944) Close `NioBufferedFileInputStream` opened by `ExternalAppendOnlyUnsafeRowArraySuite`

[ https://issues.apache.org/jira/browse/SPARK-38944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38944: Assignee: Yang Jie > Close `NioBufferedFileInputStream` opened by >

[jira] [Commented] (SPARK-34079) Merge non-correlated scalar subqueries

[ https://issues.apache.org/jira/browse/SPARK-34079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528164#comment-17528164 ] Apache Spark commented on SPARK-34079: -- User 'peter-toth' has created a pull request for this

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528141#comment-17528141 ] Apache Spark commented on SPARK-39025: -- User 'dcoliversun' has created a pull request for this

[jira] [Assigned] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39025: Assignee: Apache Spark > Add k8s Scheduling, Preemption and Eviction feature to apache

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528142#comment-17528142 ] Apache Spark commented on SPARK-39025: -- User 'dcoliversun' has created a pull request for this

[jira] [Assigned] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39025: Assignee: (was: Apache Spark) > Add k8s Scheduling, Preemption and Eviction feature

[jira] [Assigned] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39027: Assignee: Max Gekk (was: Apache Spark) > Output SQL statements in upper case in error

[jira] [Assigned] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39027: Assignee: Apache Spark (was: Max Gekk) > Output SQL statements in upper case in error

[jira] [Commented] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528089#comment-17528089 ] Apache Spark commented on SPARK-39027: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-39027) Output SQL statements in upper case in error messages

[ https://issues.apache.org/jira/browse/SPARK-39027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39027: - Description: Output SQL statements in upper case ONLY in error messages. For example, the error

[jira] [Created] (SPARK-39027) Output SQL statements in upper case in error messages

Max Gekk created SPARK-39027: Summary: Output SQL statements in upper case in error messages Key: SPARK-39027 URL: https://issues.apache.org/jira/browse/SPARK-39027 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528088#comment-17528088 ] Hyukjin Kwon commented on SPARK-39025: -- You don't have to be assigned. Once you open a PR, that

[jira] [Assigned] (SPARK-39026) Add k8s tolerations support for apache spark

[ https://issues.apache.org/jira/browse/SPARK-39026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39026: Assignee: Apache Spark > Add k8s tolerations support for apache spark >

[jira] [Assigned] (SPARK-39026) Add k8s tolerations support for apache spark

[ https://issues.apache.org/jira/browse/SPARK-39026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39026: Assignee: (was: Apache Spark) > Add k8s tolerations support for apache spark >

[jira] [Commented] (SPARK-39026) Add k8s tolerations support for apache spark

[ https://issues.apache.org/jira/browse/SPARK-39026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528087#comment-17528087 ] Apache Spark commented on SPARK-39026: -- User 'dcoliversun' has created a pull request for this

[jira] [Created] (SPARK-39026) Add k8s tolerations support for apache spark

qian created SPARK-39026: Summary: Add k8s tolerations support for apache spark Key: SPARK-39026 URL: https://issues.apache.org/jira/browse/SPARK-39026 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

[ https://issues.apache.org/jira/browse/SPARK-39025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528081#comment-17528081 ] qian commented on SPARK-39025: -- I am working on this. Please assign to me [~dongjoon]  [~hyukjin.kwon]  >

[jira] [Created] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

qian created SPARK-39025: Summary: Add k8s Scheduling, Preemption and Eviction feature to apache spark Key: SPARK-39025 URL: https://issues.apache.org/jira/browse/SPARK-39025 Project: Spark Issue

[jira] [Resolved] (SPARK-38821) test_nsmallest test failed tue to pandas 1.4.0-1.4.2 bug

[ https://issues.apache.org/jira/browse/SPARK-38821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38821. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36356

[jira] [Assigned] (SPARK-38821) test_nsmallest test failed tue to pandas 1.4.0-1.4.2 bug

[ https://issues.apache.org/jira/browse/SPARK-38821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38821: Assignee: Yikun Jiang > test_nsmallest test failed tue to pandas 1.4.0-1.4.2 bug >

[jira] [Commented] (SPARK-39022) Spark SQL - Combination of HAVING and SORT not resolved correctly

[ https://issues.apache.org/jira/browse/SPARK-39022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528071#comment-17528071 ] Lukas Grasmann commented on SPARK-39022: I am working on a Pull Request for this issue in case

[jira] [Commented] (SPARK-39023) Add Executor Pod inter-pod anti-affinity

[ https://issues.apache.org/jira/browse/SPARK-39023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528056#comment-17528056 ] Apache Spark commented on SPARK-39023: -- User 'zwangsheng' has created a pull request for this

[jira] [Assigned] (SPARK-39023) Add Executor Pod inter-pod anti-affinity

[ https://issues.apache.org/jira/browse/SPARK-39023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39023: Assignee: (was: Apache Spark) > Add Executor Pod inter-pod anti-affinity >

[jira] [Assigned] (SPARK-39023) Add Executor Pod inter-pod anti-affinity

[ https://issues.apache.org/jira/browse/SPARK-39023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39023: Assignee: Apache Spark > Add Executor Pod inter-pod anti-affinity >

[jira] [Commented] (SPARK-39023) Add Executor Pod inter-pod anti-affinity

[ https://issues.apache.org/jira/browse/SPARK-39023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528055#comment-17528055 ] Apache Spark commented on SPARK-39023: -- User 'zwangsheng' has created a pull request for this

[jira] [Created] (SPARK-39024) Add support for YARN decommissioning when ESS is Enabled

Abhishek Dixit created SPARK-39024: -- Summary: Add support for YARN decommissioning when ESS is Enabled Key: SPARK-39024 URL: https://issues.apache.org/jira/browse/SPARK-39024 Project: Spark

[jira] [Updated] (SPARK-39023) Add Executor Pod inter-pod anti-affinity

[ https://issues.apache.org/jira/browse/SPARK-39023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] binjie yang updated SPARK-39023: Summary: Add Executor Pod inter-pod anti-affinity (was: Add Executor Pod inter-pod

[jira] [Created] (SPARK-39023) Add Executor Pod inter-pod anti-addinity

binjie yang created SPARK-39023: --- Summary: Add Executor Pod inter-pod anti-addinity Key: SPARK-39023 URL: https://issues.apache.org/jira/browse/SPARK-39023 Project: Spark Issue Type: New

  1   2   >