[jira] [Commented] (SPARK-39469) Infer date type for CSV schema inference

2022-09-26 Thread Anuradha Bhan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609338#comment-17609338 ] Anuradha Bhan commented on SPARK-39469: --- [~apachespark] , when will this fix relea

[jira] [Created] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

2022-09-26 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-40559: - Summary: Add applyInArrow to pyspark.sql.GroupedData Key: SPARK-40559 URL: https://issues.apache.org/jira/browse/SPARK-40559 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-40554) Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbitary integers

2022-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40554: - Assignee: Ruifeng Zheng > Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbita

[jira] [Resolved] (SPARK-40554) Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbitary integers

2022-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40554. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37992 [https://

[jira] [Commented] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

2022-09-26 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609343#comment-17609343 ] Enrico Minack commented on SPARK-40559: --- [~cloud_fan] [~hyukjin.kwon] [~XinrongM]

[jira] [Resolved] (SPARK-40540) Migrate compilation errors onto error classes

2022-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40540. -- Resolution: Fixed Issue resolved by pull request 37973 [https://github.com/apache/spark/pull/37973] >

[jira] [Updated] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

2022-09-26 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-40559: -- Description: PySpark allows to transform a {{DataFrame}} via Pandas and Arrow API: {code:pyth

[jira] [Comment Edited] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

2022-09-26 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609343#comment-17609343 ] Enrico Minack edited comment on SPARK-40559 at 9/26/22 7:30 AM: --

[jira] [Updated] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

2022-09-26 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-40559: -- Description: PySpark allows to transform a {{DataFrame}} via Pandas and Arrow API: {code:pyth

[jira] [Assigned] (SPARK-40530) Add error-related developer APIs

2022-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40530: --- Assignee: Wenchen Fan > Add error-related developer APIs >

[jira] [Resolved] (SPARK-40530) Add error-related developer APIs

2022-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40530. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37969 [https://gith

[jira] [Resolved] (SPARK-40501) Add PushProjectionThroughLimit for Optimizer

2022-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40501. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37941 [https://gith

[jira] [Assigned] (SPARK-40501) Add PushProjectionThroughLimit for Optimizer

2022-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40501: --- Assignee: BingKun Pan > Add PushProjectionThroughLimit for Optimizer >

[jira] [Created] (SPARK-40560) Rename message to messageFormat in the STANDARD format of errors

2022-09-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-40560: Summary: Rename message to messageFormat in the STANDARD format of errors Key: SPARK-40560 URL: https://issues.apache.org/jira/browse/SPARK-40560 Project: Spark Iss

[jira] [Assigned] (SPARK-40560) Rename message to messageFormat in the STANDARD format of errors

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40560: Assignee: Apache Spark (was: Max Gekk) > Rename message to messageFormat in the STANDARD

[jira] [Assigned] (SPARK-40560) Rename message to messageFormat in the STANDARD format of errors

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40560: Assignee: Max Gekk (was: Apache Spark) > Rename message to messageFormat in the STANDARD

[jira] [Commented] (SPARK-40560) Rename message to messageFormat in the STANDARD format of errors

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609361#comment-17609361 ] Apache Spark commented on SPARK-40560: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-40561) Implement `min_count` in GroupBy.min

2022-09-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40561: - Summary: Implement `min_count` in GroupBy.min Key: SPARK-40561 URL: https://issues.apache.org/jira/browse/SPARK-40561 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-40561) Implement `min_count` in GroupBy.min

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40561: Assignee: (was: Apache Spark) > Implement `min_count` in GroupBy.min > --

[jira] [Commented] (SPARK-40561) Implement `min_count` in GroupBy.min

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609364#comment-17609364 ] Apache Spark commented on SPARK-40561: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40561) Implement `min_count` in GroupBy.min

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40561: Assignee: Apache Spark > Implement `min_count` in GroupBy.min > -

[jira] [Commented] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

2022-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609366#comment-17609366 ] Hyukjin Kwon commented on SPARK-40559: -- You can actually mimic this behaviour via

[jira] [Commented] (SPARK-39146) The singleton Jackson ObjectMapper should be preferred

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609374#comment-17609374 ] Apache Spark commented on SPARK-39146: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39146) The singleton Jackson ObjectMapper should be preferred

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39146: Assignee: (was: Apache Spark) > The singleton Jackson ObjectMapper should be preferre

[jira] [Assigned] (SPARK-39146) The singleton Jackson ObjectMapper should be preferred

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39146: Assignee: Apache Spark > The singleton Jackson ObjectMapper should be preferred > ---

[jira] [Commented] (SPARK-40540) Migrate compilation errors onto error classes

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609397#comment-17609397 ] Apache Spark commented on SPARK-40540: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-40540) Migrate compilation errors onto error classes

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609398#comment-17609398 ] Apache Spark commented on SPARK-40540: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-40562) Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy

2022-09-26 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-40562: - Summary: Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy Key: SPARK-40562 URL: https://issues.apache.org/jira/browse/SPARK-40562 Project: Spark Issu

[jira] [Assigned] (SPARK-40562) Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40562: Assignee: Apache Spark > Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy > ---

[jira] [Commented] (SPARK-40562) Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609407#comment-17609407 ] Apache Spark commented on SPARK-40562: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-40562) Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40562: Assignee: (was: Apache Spark) > Add spark.sql.legacy.groupingIdWithAppendedUserGroupB

[jira] [Commented] (SPARK-40562) Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609408#comment-17609408 ] Apache Spark commented on SPARK-40562: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-40563) Error at where clause, when sql case executes on else branch

2022-09-26 Thread Vadim (Jira)
Vadim created SPARK-40563: - Summary: Error at where clause, when sql case executes on else branch Key: SPARK-40563 URL: https://issues.apache.org/jira/browse/SPARK-40563 Project: Spark Issue Type: B

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: test.sql > Error at where clause, when sql case executes on else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes on else branch > ---

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: stack-trace.txt > Error at where clause, when sql case executes on else branch > -

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repo

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Summary: Error at where clause, when sql case executes by else branch (was: Error at where clause, when sql c

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example.txt) > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example-1.txt) > Error at where clause, when sql case executes by else branch

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: test.txt) > Error at where clause, when sql case executes by else branch > -

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: sql.txt > Error at where clause, when sql case executes by else branch > -

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: test.txt > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes by else branch > ---

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example-1.txt > Error at where clause, when sql case executes by else branch > -

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: test.sql) > Error at where clause, when sql case executes by else branch > -

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example.txt) > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes by else branch > ---

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: sql.txt > Error at where clause, when sql case executes by else branch > -

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: sql.txt) > Error at where clause, when sql case executes by else branch > --

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: sql.txt) > Error at where clause, when sql case executes by else branch > --

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: sql.txt > Error at where clause, when sql case executes by else branch > -

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug repor

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example.txt) > Error at where clause, when sql case executes by else branch >

[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes by else branch > ---

[jira] [Resolved] (SPARK-40560) Rename message to messageFormat in the STANDARD format of errors

2022-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40560. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37997 [https://github.com

[jira] [Created] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
YuNing Liu created SPARK-40564: -- Summary: The distributed runtime has one more identical process with a small amount of data on the master Key: SPARK-40564 URL: https://issues.apache.org/jira/browse/SPARK-40564

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Remaining Estimate: (was: 672h) Original Estimate: (was: 672h) > The distributed runtim

[jira] [Created] (SPARK-40565) Non-deterministic filters shouldn't get pushed to V2 file sources

2022-09-26 Thread Adam Binford (Jira)
Adam Binford created SPARK-40565: Summary: Non-deterministic filters shouldn't get pushed to V2 file sources Key: SPARK-40565 URL: https://issues.apache.org/jira/browse/SPARK-40565 Project: Spark

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Attachment: (was: 2022-09-26 20-54-37 的屏幕截图.png) > The distributed runtime has one more identica

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Attachment: Value of df.png > The distributed runtime has one more identical process with a small am

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Attachment: The output of the abnormal process.png > The distributed runtime has one more identical

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Attachment: Part of the code.png > The distributed runtime has one more identical process with a sma

[jira] [Updated] (SPARK-40564) The distributed runtime has one more identical process with a small amount of data on the master

2022-09-26 Thread YuNing Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuNing Liu updated SPARK-40564: --- Description: When I ran my program with the Dataframe structure in Pyspark.PANDAS, there is an abnor

[jira] [Assigned] (SPARK-40565) Non-deterministic filters shouldn't get pushed to V2 file sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40565: Assignee: (was: Apache Spark) > Non-deterministic filters shouldn't get pushed to V2

[jira] [Commented] (SPARK-40565) Non-deterministic filters shouldn't get pushed to V2 file sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609489#comment-17609489 ] Apache Spark commented on SPARK-40565: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-40565) Non-deterministic filters shouldn't get pushed to V2 file sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40565: Assignee: Apache Spark > Non-deterministic filters shouldn't get pushed to V2 file source

[jira] [Created] (SPARK-40566) Add showIndex function

2022-09-26 Thread KaiXinXIaoLei (Jira)
KaiXinXIaoLei created SPARK-40566: - Summary: Add showIndex function Key: SPARK-40566 URL: https://issues.apache.org/jira/browse/SPARK-40566 Project: Spark Issue Type: New Feature C

[jira] [Created] (SPARK-40567) SharedState to redact secrets when propagating them to HadoopConf

2022-09-26 Thread Steve Loughran (Jira)
Steve Loughran created SPARK-40567: -- Summary: SharedState to redact secrets when propagating them to HadoopConf Key: SPARK-40567 URL: https://issues.apache.org/jira/browse/SPARK-40567 Project: Spark

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

2022-09-26 Thread John Pellman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609507#comment-17609507 ] John Pellman commented on SPARK-12216: -- Just as another data point, it appears that

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2022-09-26 Thread John Pellman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609507#comment-17609507 ] John Pellman edited comment on SPARK-12216 at 9/26/22 1:40 PM: ---

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2022-09-26 Thread John Pellman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609507#comment-17609507 ] John Pellman edited comment on SPARK-12216 at 9/26/22 1:42 PM: ---

[jira] [Assigned] (SPARK-40478) Add create datasource table options docs

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40478: Assignee: XiDuo You > Add create datasource table options docs >

[jira] [Resolved] (SPARK-40478) Add create datasource table options docs

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40478. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37919 [https://gi

[jira] [Updated] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40552: - Component/s: Build > Upgrade protobuf-python from 4.21.5 to 4.21.6 > ---

[jira] [Assigned] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40552: Assignee: Bjørn Jørgensen > Upgrade protobuf-python from 4.21.5 to 4.21.6 > -

[jira] [Resolved] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40552. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37991 [https://gi

[jira] [Updated] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

2022-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40552: - Priority: Minor (was: Major) > Upgrade protobuf-python from 4.21.5 to 4.21.6 >

[jira] [Created] (SPARK-40568) Spark Streaming support Debezium

2022-09-26 Thread melin (Jira)
melin created SPARK-40568: - Summary: Spark Streaming support Debezium Key: SPARK-40568 URL: https://issues.apache.org/jira/browse/SPARK-40568 Project: Spark Issue Type: Improvement Componen

[jira] [Commented] (SPARK-40563) Error at where clause, when sql case executes by else branch

2022-09-26 Thread zzzzming95 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609536#comment-17609536 ] ming95 commented on SPARK-40563: I can reproduce this problem. I can try to fix

[jira] [Resolved] (SPARK-40357) Migrate window type check failures onto error classes

2022-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40357. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37986 [https://github.com

[jira] [Assigned] (SPARK-40357) Migrate window type check failures onto error classes

2022-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40357: Assignee: Shaokang Lv > Migrate window type check failures onto error classes > -

[jira] [Commented] (SPARK-40358) Migrate collection type check failures onto error classes

2022-09-26 Thread Shaokang Lv (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609584#comment-17609584 ] Shaokang Lv commented on SPARK-40358: - Hi, [~maxgekk] , I will pick up this if possi

[jira] [Commented] (SPARK-40358) Migrate collection type check failures onto error classes

2022-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609592#comment-17609592 ] Max Gekk commented on SPARK-40358: -- [~lvshaokang] Sure, go ahead. > Migrate collection

[jira] [Assigned] (SPARK-40551) DataSource V2: Add APIs for delta-based row-level operations

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40551: Assignee: (was: Apache Spark) > DataSource V2: Add APIs for delta-based row-level ope

[jira] [Assigned] (SPARK-40551) DataSource V2: Add APIs for delta-based row-level operations

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40551: Assignee: Apache Spark > DataSource V2: Add APIs for delta-based row-level operations > -

[jira] [Commented] (SPARK-40551) DataSource V2: Add APIs for delta-based row-level operations

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609688#comment-17609688 ] Apache Spark commented on SPARK-40551: -- User 'aokolnychyi' has created a pull reque

[jira] [Assigned] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40550: Assignee: Apache Spark > DataSource V2: Handle DELETE commands for delta-based sources >

[jira] [Assigned] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40550: Assignee: (was: Apache Spark) > DataSource V2: Handle DELETE commands for delta-based

[jira] [Commented] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

2022-09-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609690#comment-17609690 ] Apache Spark commented on SPARK-40550: -- User 'aokolnychyi' has created a pull reque

  1   2   >