[jira] [Commented] (SPARK-38443) Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502780#comment-17502780 ] Apache Spark commented on SPARK-38443: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-38443) Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502779#comment-17502779 ] Apache Spark commented on SPARK-38443: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38443) Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38443: Assignee: (was: Apache Spark) > Document config

[jira] [Assigned] (SPARK-38443) Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38443: Assignee: Apache Spark > Document config

[jira] [Created] (SPARK-38443) Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION

2022-03-07 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-38443: --- Summary: Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION Key: SPARK-38443 URL: https://issues.apache.org/jira/browse/SPARK-38443 Project:

[jira] [Commented] (SPARK-38379) Kubernetes: NoSuchElementException: spark.app.id when using PersistentVolumes

2022-03-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502771#comment-17502771 ] Dongjoon Hyun commented on SPARK-38379: --- Thank you for your investigation, [~tgraves]. >

[jira] [Assigned] (SPARK-38442) Fix ConstantFoldingSuite/ColumnExpressionSuite/DataFrameSuite/AdaptiveQueryExecSuite under ANSI mode

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38442: Assignee: Gengliang Wang (was: Apache Spark) > Fix >

[jira] [Commented] (SPARK-38442) Fix ConstantFoldingSuite/ColumnExpressionSuite/DataFrameSuite/AdaptiveQueryExecSuite under ANSI mode

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502761#comment-17502761 ] Apache Spark commented on SPARK-38442: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-38442) Fix ConstantFoldingSuite/ColumnExpressionSuite/DataFrameSuite/AdaptiveQueryExecSuite under ANSI mode

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502759#comment-17502759 ] Apache Spark commented on SPARK-38442: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-38442) Fix ConstantFoldingSuite/ColumnExpressionSuite/DataFrameSuite/AdaptiveQueryExecSuite under ANSI mode

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38442: Assignee: Apache Spark (was: Gengliang Wang) > Fix >

[jira] [Created] (SPARK-38442) Fix ConstantFoldingSuite/ColumnExpressionSuite/DataFrameSuite/AdaptiveQueryExecSuite under ANSI mode

2022-03-07 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-38442: -- Summary: Fix ConstantFoldingSuite/ColumnExpressionSuite/DataFrameSuite/AdaptiveQueryExecSuite under ANSI mode Key: SPARK-38442 URL:

[jira] [Commented] (SPARK-38441) Support string and bool `regex` in `Series.replace`

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502753#comment-17502753 ] Apache Spark commented on SPARK-38441: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-38441) Support string and bool `regex` in `Series.replace`

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38441: Assignee: Apache Spark > Support string and bool `regex` in `Series.replace` >

[jira] [Assigned] (SPARK-38441) Support string and bool `regex` in `Series.replace`

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38441: Assignee: (was: Apache Spark) > Support string and bool `regex` in `Series.replace`

[jira] [Commented] (SPARK-37690) Recursive view `df` detected (cycle: `df` -> `df`)

2022-03-07 Thread Yishai Chernovitzky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502743#comment-17502743 ] Yishai Chernovitzky commented on SPARK-37690: - It seems to be resolved by SPARK-38318 >

[jira] [Created] (SPARK-38441) Support string and bool `regex` in `Series.replace`

2022-03-07 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-38441: Summary: Support string and bool `regex` in `Series.replace` Key: SPARK-38441 URL: https://issues.apache.org/jira/browse/SPARK-38441 Project: Spark Issue

[jira] [Commented] (SPARK-37865) Spark should not dedup the groupingExpressions when the first child of Union has duplicate columns

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502724#comment-17502724 ] Apache Spark commented on SPARK-37865: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38103) Use error classes in the parsing errors of transform

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38103: Assignee: Apache Spark > Use error classes in the parsing errors of transform >

[jira] [Assigned] (SPARK-38103) Use error classes in the parsing errors of transform

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38103: Assignee: (was: Apache Spark) > Use error classes in the parsing errors of transform

[jira] [Commented] (SPARK-38103) Use error classes in the parsing errors of transform

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502725#comment-17502725 ] Apache Spark commented on SPARK-38103: -- User 'yutoacts' has created a pull request for this issue:

[jira] [Commented] (SPARK-38439) Add Braces with if,else,for,do and while statements

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502712#comment-17502712 ] Apache Spark commented on SPARK-38439: -- User 'dcoliversun' has created a pull request for this

[jira] [Assigned] (SPARK-38439) Add Braces with if,else,for,do and while statements

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38439: Assignee: (was: Apache Spark) > Add Braces with if,else,for,do and while statements

[jira] [Assigned] (SPARK-38439) Add Braces with if,else,for,do and while statements

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38439: Assignee: Apache Spark > Add Braces with if,else,for,do and while statements >

[jira] [Comment Edited] (SPARK-38438) Can't update spark.jars.packages on existing global/default context

2022-03-07 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502633#comment-17502633 ] Rafal Wojdyla edited comment on SPARK-38438 at 3/8/22, 4:33 AM: The

[jira] [Created] (SPARK-38440) DataFilter pushed down with PartitionFilter fro Parquet V1 Datasource

2022-03-07 Thread Jackey Lee (Jira)
Jackey Lee created SPARK-38440: -- Summary: DataFilter pushed down with PartitionFilter fro Parquet V1 Datasource Key: SPARK-38440 URL: https://issues.apache.org/jira/browse/SPARK-38440 Project: Spark

[jira] [Resolved] (SPARK-37895) Error while joining two tables with non-english field names

2022-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37895. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35726

[jira] [Assigned] (SPARK-37895) Error while joining two tables with non-english field names

2022-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37895: --- Assignee: Pablo Langa Blanco > Error while joining two tables with non-english field names

[jira] [Commented] (SPARK-38282) Avoid duplicating complex partitioning expressions

2022-03-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502674#comment-17502674 ] Yuming Wang commented on SPARK-38282: - Some related PRs: https://github.com/apache/spark/pull/33522

[jira] [Created] (SPARK-38439) Add Braces with if,else,for,do and while statements

2022-03-07 Thread qian (Jira)
qian created SPARK-38439: Summary: Add Braces with if,else,for,do and while statements Key: SPARK-38439 URL: https://issues.apache.org/jira/browse/SPARK-38439 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-38385) Improve error messages of 'mismatched input' cases from ANTLR

2022-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38385: --- Assignee: Xinyi Yu > Improve error messages of 'mismatched input' cases from ANTLR >

[jira] [Resolved] (SPARK-38385) Improve error messages of 'mismatched input' cases from ANTLR

2022-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38385. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35707

[jira] [Updated] (SPARK-38438) Can't update spark.jars.packages on existing global/default context

2022-03-07 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated SPARK-38438: -- Issue Type: Bug (was: New Feature) > Can't update spark.jars.packages on existing

[jira] [Commented] (SPARK-38438) Can't update spark.jars.packages on existing global/default context

2022-03-07 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502633#comment-17502633 ] Rafal Wojdyla commented on SPARK-38438: --- The workaround actually doesn't stop the existing JVM, it

[jira] [Updated] (SPARK-38438) Can't update spark.jars.packages on existing global/default context

2022-03-07 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated SPARK-38438: -- Description: Reproduction: {code:python} from pyspark.sql import SparkSession # default

[jira] [Created] (SPARK-38438) Can't update spark.jars.packages on existing global/default context

2022-03-07 Thread Rafal Wojdyla (Jira)
Rafal Wojdyla created SPARK-38438: - Summary: Can't update spark.jars.packages on existing global/default context Key: SPARK-38438 URL: https://issues.apache.org/jira/browse/SPARK-38438 Project: Spark

[jira] [Commented] (SPARK-38183) Show warning when creating pandas-on-Spark session under ANSI mode.

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502610#comment-17502610 ] Apache Spark commented on SPARK-38183: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-38379) Kubernetes: NoSuchElementException: spark.app.id when using PersistentVolumes

2022-03-07 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502555#comment-17502555 ] Thomas Graves commented on SPARK-38379: --- so I actually created another pod with Spark client in it

[jira] [Resolved] (SPARK-38285) ClassCastException: GenericArrayData cannot be cast to InternalRow

2022-03-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-38285. - Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-38285) ClassCastException: GenericArrayData cannot be cast to InternalRow

2022-03-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-38285: --- Assignee: L. C. Hsieh > ClassCastException: GenericArrayData cannot be cast to InternalRow

[jira] [Commented] (SPARK-38402) Improve user experience when working on data frames created from CSV and JSON in PERMISSIVE mode.

2022-03-07 Thread Dilip Biswal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502532#comment-17502532 ] Dilip Biswal commented on SPARK-38402: -- [~hyukjin.kwon] Thanks !! Yeah, that should work. The only

[jira] [Assigned] (SPARK-38437) Dynamic serialization of Java datetime objects to micros/days

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38437: Assignee: (was: Apache Spark) > Dynamic serialization of Java datetime objects to

[jira] [Assigned] (SPARK-38437) Dynamic serialization of Java datetime objects to micros/days

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38437: Assignee: Apache Spark > Dynamic serialization of Java datetime objects to micros/days >

[jira] [Commented] (SPARK-38437) Dynamic serialization of Java datetime objects to micros/days

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502530#comment-17502530 ] Apache Spark commented on SPARK-38437: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-38437) Dynamic serialization of Java datetime objects to micros/days

2022-03-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-38437: Summary: Dynamic serialization of Java datetime objects to micros/days Key: SPARK-38437 URL: https://issues.apache.org/jira/browse/SPARK-38437 Project: Spark Issue

[jira] [Resolved] (SPARK-38436) Duplicate test_floor functions

2022-03-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38436. --- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-38436) Fix `test_ceil` to test `ceil`

2022-03-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38436: -- Summary: Fix `test_ceil` to test `ceil` (was: Duplicate test_floor functions ) > Fix

[jira] [Assigned] (SPARK-38436) Duplicate test_floor functions

2022-03-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38436: - Assignee: Bjørn Jørgensen > Duplicate test_floor functions >

[jira] [Resolved] (SPARK-38414) Remove redundant SuppressWarnings

2022-03-07 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-38414. Fix Version/s: 3.3.0 Assignee: Yang Jie Resolution: Fixed > Remove redundant

[jira] [Commented] (SPARK-38388) Repartition + Stage retries could lead to incorrect data

2022-03-07 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502486#comment-17502486 ] Xingbo Jiang commented on SPARK-38388: -- I see in your example you used `rand()` function between

[jira] [Commented] (SPARK-38388) Repartition + Stage retries could lead to incorrect data

2022-03-07 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502481#comment-17502481 ] Xingbo Jiang commented on SPARK-38388: -- > upstream stage (data with randomness) I assume you are

[jira] [Comment Edited] (SPARK-38388) Repartition + Stage retries could lead to incorrect data

2022-03-07 Thread Jason Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501894#comment-17501894 ] Jason Xu edited comment on SPARK-38388 at 3/7/22, 6:08 PM: --- [~jiangxb1987]

[jira] [Assigned] (SPARK-38104) Use error classes in the parsing errors of windows

2022-03-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38104: Assignee: Yuto Akutsu > Use error classes in the parsing errors of windows >

[jira] [Resolved] (SPARK-38104) Use error classes in the parsing errors of windows

2022-03-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38104. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35718

[jira] [Commented] (SPARK-38282) Avoid duplicating complex partitioning expressions

2022-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502373#comment-17502373 ] Wenchen Fan commented on SPARK-38282: - cc [~yumwang] [~chengsu]  > Avoid duplicating complex

[jira] [Assigned] (SPARK-38436) Duplicate test_floor functions

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38436: Assignee: (was: Apache Spark) > Duplicate test_floor functions >

[jira] [Commented] (SPARK-38436) Duplicate test_floor functions

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502315#comment-17502315 ] Apache Spark commented on SPARK-38436: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Commented] (SPARK-38436) Duplicate test_floor functions

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502316#comment-17502316 ] Apache Spark commented on SPARK-38436: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Assigned] (SPARK-38436) Duplicate test_floor functions

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38436: Assignee: Apache Spark > Duplicate test_floor functions >

[jira] [Created] (SPARK-38436) Duplicate test_floor functions

2022-03-07 Thread Jira
Bjørn Jørgensen created SPARK-38436: --- Summary: Duplicate test_floor functions Key: SPARK-38436 URL: https://issues.apache.org/jira/browse/SPARK-38436 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-38434) Correct semantic of CheckAnalysis.getDataTypesAreCompatibleFn method

2022-03-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-38434: -- Assignee: huangtengfei > Correct semantic of

[jira] [Resolved] (SPARK-38434) Correct semantic of CheckAnalysis.getDataTypesAreCompatibleFn method

2022-03-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38434. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35752

[jira] [Commented] (SPARK-38407) ANSI Cast: loosen the limitation of casting non-null complex types

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502239#comment-17502239 ] Apache Spark commented on SPARK-38407: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-38435) Pandas UDF with type hints crashes at import

2022-03-07 Thread Julien Peloton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Peloton updated SPARK-38435: --- Description: h2. Old style pandas UDF let's consider a pandas UDF defined in the old

[jira] [Updated] (SPARK-38435) Pandas UDF with type hints crashes at import

2022-03-07 Thread Julien Peloton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Peloton updated SPARK-38435: --- Description: h2. Old style pandas UDF let's consider a pandas UDF defined in the old

[jira] [Updated] (SPARK-38435) Pandas UDF with type hints crashes at import

2022-03-07 Thread Julien Peloton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Peloton updated SPARK-38435: --- Description: h2. Old style pandas UDF let's consider a pandas UDF defined in the old

[jira] [Updated] (SPARK-38435) Pandas UDF with type hints crashes at import

2022-03-07 Thread Julien Peloton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Peloton updated SPARK-38435: --- Description: h2. Old style pandas UDF let's consider a pandas UDF defined in the old

[jira] [Updated] (SPARK-38435) Pandas UDF with type hints crashes at import

2022-03-07 Thread Julien Peloton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Peloton updated SPARK-38435: --- Description: h2. Old style pandas UDF let's consider a pandas UDF defined in the old

[jira] [Updated] (SPARK-38435) Pandas UDF with type hints crashes at import

2022-03-07 Thread Julien Peloton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Peloton updated SPARK-38435: --- Description: h2. Old style pandas UDF let's consider a pandas UDF defined in the old

[jira] [Updated] (SPARK-38435) Pandas UDF with type hints crashes at import

2022-03-07 Thread Julien Peloton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Peloton updated SPARK-38435: --- Description: h2. Old style pandas UDF let's consider a pandas UDF defined in the old

[jira] [Created] (SPARK-38435) Pandas UDF with type hints crashes at import

2022-03-07 Thread Julien Peloton (Jira)
Julien Peloton created SPARK-38435: -- Summary: Pandas UDF with type hints crashes at import Key: SPARK-38435 URL: https://issues.apache.org/jira/browse/SPARK-38435 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38394) build of spark sql against hadoop-3.4.0-snapshot failing with bouncycastle classpath error

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502219#comment-17502219 ] Apache Spark commented on SPARK-38394: -- User 'steveloughran' has created a pull request for this

[jira] [Commented] (SPARK-38394) build of spark sql against hadoop-3.4.0-snapshot failing with bouncycastle classpath error

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502218#comment-17502218 ] Apache Spark commented on SPARK-38394: -- User 'steveloughran' has created a pull request for this

[jira] [Commented] (SPARK-38434) Correct semantic of CheckAnalysis.getDataTypesAreCompatibleFn method

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502214#comment-17502214 ] Apache Spark commented on SPARK-38434: -- User 'ivoson' has created a pull request for this issue:

[jira] [Commented] (SPARK-38434) Correct semantic of CheckAnalysis.getDataTypesAreCompatibleFn method

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502215#comment-17502215 ] Apache Spark commented on SPARK-38434: -- User 'ivoson' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38434) Correct semantic of CheckAnalysis.getDataTypesAreCompatibleFn method

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38434: Assignee: (was: Apache Spark) > Correct semantic of

[jira] [Assigned] (SPARK-38434) Correct semantic of CheckAnalysis.getDataTypesAreCompatibleFn method

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38434: Assignee: Apache Spark > Correct semantic of CheckAnalysis.getDataTypesAreCompatibleFn

[jira] [Created] (SPARK-38434) Correct semantic of CheckAnalysis.getDataTypesAreCompatibleFn method

2022-03-07 Thread huangtengfei (Jira)
huangtengfei created SPARK-38434: Summary: Correct semantic of CheckAnalysis.getDataTypesAreCompatibleFn method Key: SPARK-38434 URL: https://issues.apache.org/jira/browse/SPARK-38434 Project: Spark

[jira] [Resolved] (SPARK-38413) Invalid call to exprId

2022-03-07 Thread liujintao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujintao resolved SPARK-38413. --- Resolution: Fixed > Invalid call to exprId > -- > > Key:

[jira] [Assigned] (SPARK-38433) Add Shell Code Style Check Action

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38433: Assignee: (was: Apache Spark) > Add Shell Code Style Check Action >

[jira] [Assigned] (SPARK-38433) Add Shell Code Style Check Action

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38433: Assignee: Apache Spark > Add Shell Code Style Check Action >

[jira] [Commented] (SPARK-38433) Add Shell Code Style Check Action

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502172#comment-17502172 ] Apache Spark commented on SPARK-38433: -- User 'stczwd' has created a pull request for this issue:

[jira] [Commented] (SPARK-38413) Invalid call to exprId

2022-03-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502171#comment-17502171 ] Hyukjin Kwon commented on SPARK-38413: -- It would be great to make it self-contained. Also, we won't

[jira] [Commented] (SPARK-38413) Invalid call to exprId

2022-03-07 Thread liujintao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502169#comment-17502169 ] liujintao commented on SPARK-38413: --- create view step_29100348500  as             select c_user_id,

[jira] [Assigned] (SPARK-38335) Parser changes for DEFAULT column support

2022-03-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-38335: -- Assignee: Daniel > Parser changes for DEFAULT column support >

[jira] [Commented] (SPARK-28173) Add Kafka delegation token proxy user support

2022-03-07 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502162#comment-17502162 ] Gabor Somogyi commented on SPARK-28173: --- Looks like there is a willingness to merge the Kafka

[jira] [Created] (SPARK-38433) Add Shell Code Style Check Action

2022-03-07 Thread Jackey Lee (Jira)
Jackey Lee created SPARK-38433: -- Summary: Add Shell Code Style Check Action Key: SPARK-38433 URL: https://issues.apache.org/jira/browse/SPARK-38433 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-38335) Parser changes for DEFAULT column support

2022-03-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38335. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35690

[jira] [Assigned] (SPARK-38285) ClassCastException: GenericArrayData cannot be cast to InternalRow

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38285: Assignee: Apache Spark > ClassCastException: GenericArrayData cannot be cast to

[jira] [Commented] (SPARK-38431) Support to delete matched rows from jdbc tables

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502134#comment-17502134 ] Apache Spark commented on SPARK-38431: -- User 'caican00' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38431) Support to delete matched rows from jdbc tables

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38431: Assignee: Apache Spark > Support to delete matched rows from jdbc tables >

[jira] [Assigned] (SPARK-38431) Support to delete matched rows from jdbc tables

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38431: Assignee: (was: Apache Spark) > Support to delete matched rows from jdbc tables >

[jira] [Assigned] (SPARK-38285) ClassCastException: GenericArrayData cannot be cast to InternalRow

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38285: Assignee: (was: Apache Spark) > ClassCastException: GenericArrayData cannot be cast

[jira] [Commented] (SPARK-38285) ClassCastException: GenericArrayData cannot be cast to InternalRow

2022-03-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502135#comment-17502135 ] Apache Spark commented on SPARK-38285: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-38285) ClassCastException: GenericArrayData cannot be cast to InternalRow

2022-03-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502123#comment-17502123 ] L. C. Hsieh commented on SPARK-38285: - No worries as bug fix is not blocked by code freeze. I've

[jira] [Resolved] (SPARK-38382) Refactor migration guide's sentences

2022-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38382. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35705

[jira] [Assigned] (SPARK-38382) Refactor migration guide's sentences

2022-03-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38382: --- Assignee: angerszhu > Refactor migration guide's sentences >