[jira] [Commented] (SPARK-39863) Upgrade Hadoop to 3.3.4

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577209#comment-17577209 ] Apache Spark commented on SPARK-39863: -- User 'dongjoon-hyun' has created a pull req

[jira] (SPARK-39995) PySpark installation doesn't support Scala 2.13 binaries

2022-08-09 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39995 ] Haejoon Lee deleted comment on SPARK-39995: - was (Author: itholic): Let me take a look > PySpark installation doesn't support Scala 2.13 binaries > --

[jira] [Assigned] (SPARK-39309) '_SubTest' object has no attribute 'elapsed_time'

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39309: Assignee: Apache Spark > '_SubTest' object has no attribute 'elapsed_time' >

[jira] [Commented] (SPARK-39309) '_SubTest' object has no attribute 'elapsed_time'

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577225#comment-17577225 ] Apache Spark commented on SPARK-39309: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-39309) '_SubTest' object has no attribute 'elapsed_time'

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39309: Assignee: (was: Apache Spark) > '_SubTest' object has no attribute 'elapsed_time' > -

[jira] [Commented] (SPARK-39309) '_SubTest' object has no attribute 'elapsed_time'

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577227#comment-17577227 ] Apache Spark commented on SPARK-39309: -- User 'Yikun' has created a pull request for

[jira] [Created] (SPARK-40017) Adjust advisory partition size in bytes based on the following operators

2022-08-09 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40017: --- Summary: Adjust advisory partition size in bytes based on the following operators Key: SPARK-40017 URL: https://issues.apache.org/jira/browse/SPARK-40017 Project: Spark

[jira] [Commented] (SPARK-39734) Add call_udf to pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577311#comment-17577311 ] Apache Spark commented on SPARK-39734: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-39734) Add call_udf to pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39734: Assignee: Apache Spark > Add call_udf to pyspark.sql.functions >

[jira] [Assigned] (SPARK-39734) Add call_udf to pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39734: Assignee: (was: Apache Spark) > Add call_udf to pyspark.sql.functions > -

[jira] [Commented] (SPARK-36259) Expose localtimestamp in pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577312#comment-17577312 ] Apache Spark commented on SPARK-36259: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-36259) Expose localtimestamp in pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577313#comment-17577313 ] Apache Spark commented on SPARK-36259: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-39733) Add map_contains_key to pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577316#comment-17577316 ] Apache Spark commented on SPARK-39733: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-39733) Add map_contains_key to pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577317#comment-17577317 ] Apache Spark commented on SPARK-39733: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-39733) Add map_contains_key to pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39733: Assignee: (was: Apache Spark) > Add map_contains_key to pyspark.sql.functions > -

[jira] [Commented] (SPARK-37348) PySpark pmod function

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577322#comment-17577322 ] Apache Spark commented on SPARK-37348: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-39994) How to write (save) PySpark dataframe containing vector column?

2022-08-09 Thread Muhammad Kaleem Ullah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577319#comment-17577319 ] Muhammad Kaleem Ullah commented on SPARK-39994: --- Yes, I agree. > How to w

[jira] [Commented] (SPARK-37348) PySpark pmod function

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577324#comment-17577324 ] Apache Spark commented on SPARK-37348: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-39733) Add map_contains_key to pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39733: Assignee: Apache Spark > Add map_contains_key to pyspark.sql.functions >

[jira] [Commented] (SPARK-37348) PySpark pmod function

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577323#comment-17577323 ] Apache Spark commented on SPARK-37348: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-37348) PySpark pmod function

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37348: Assignee: (was: Apache Spark) > PySpark pmod function > - > >

[jira] [Assigned] (SPARK-37348) PySpark pmod function

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37348: Assignee: Apache Spark > PySpark pmod function > - > >

[jira] [Commented] (SPARK-39733) Add map_contains_key to pyspark.sql.functions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577320#comment-17577320 ] Apache Spark commented on SPARK-39733: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-37348) PySpark pmod function

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577327#comment-17577327 ] Apache Spark commented on SPARK-37348: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-37348) PySpark pmod function

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577328#comment-17577328 ] Apache Spark commented on SPARK-37348: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-40010) Make pyspark.sql.window examples self-contained

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577329#comment-17577329 ] Apache Spark commented on SPARK-40010: -- User 'dcoliversun' has created a pull reque

[jira] [Assigned] (SPARK-40010) Make pyspark.sql.window examples self-contained

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40010: Assignee: (was: Apache Spark) > Make pyspark.sql.window examples self-contained > ---

[jira] [Assigned] (SPARK-40010) Make pyspark.sql.window examples self-contained

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40010: Assignee: Apache Spark > Make pyspark.sql.window examples self-contained > --

[jira] [Assigned] (SPARK-40017) Adjust advisory partition size in bytes based on the following operators

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40017: Assignee: (was: Apache Spark) > Adjust advisory partition size in bytes based on the

[jira] [Commented] (SPARK-40017) Adjust advisory partition size in bytes based on the following operators

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577331#comment-17577331 ] Apache Spark commented on SPARK-40017: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-40017) Adjust advisory partition size in bytes based on the following operators

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40017: Assignee: Apache Spark > Adjust advisory partition size in bytes based on the following o

[jira] [Commented] (SPARK-39993) Spark on Kubernetes doesn't filter data by date

2022-08-09 Thread Hanna Liashchuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577361#comment-17577361 ] Hanna Liashchuk commented on SPARK-39993: - hi [~hyukjin.kwon], this issue makes

[jira] [Commented] (SPARK-39969) Spark AWS SDK and kinesis dependencies lagging hadoop-aws and s3a

2022-08-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577389#comment-17577389 ] Steve Loughran commented on SPARK-39969: there's an AWS SDK CVE which is fixed w

[jira] [Created] (SPARK-40018) Output SparkThrowable to SQL golden files in JSON format

2022-08-09 Thread Max Gekk (Jira)
Max Gekk created SPARK-40018: Summary: Output SparkThrowable to SQL golden files in JSON format Key: SPARK-40018 URL: https://issues.apache.org/jira/browse/SPARK-40018 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40018) Output SparkThrowable to SQL golden files in JSON format

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40018: Assignee: Max Gekk (was: Apache Spark) > Output SparkThrowable to SQL golden files in JS

[jira] [Assigned] (SPARK-40018) Output SparkThrowable to SQL golden files in JSON format

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40018: Assignee: Apache Spark (was: Max Gekk) > Output SparkThrowable to SQL golden files in JS

[jira] [Commented] (SPARK-40018) Output SparkThrowable to SQL golden files in JSON format

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577409#comment-17577409 ] Apache Spark commented on SPARK-40018: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-40019) Refactor comment of ArrayType and MapType

2022-08-09 Thread angerszhu (Jira)
angerszhu created SPARK-40019: - Summary: Refactor comment of ArrayType and MapType Key: SPARK-40019 URL: https://issues.apache.org/jira/browse/SPARK-40019 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-40019) Refactor comment of ArrayType

2022-08-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-40019: -- Summary: Refactor comment of ArrayType (was: Refactor comment of ArrayType and MapType) > Refactor c

[jira] [Resolved] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

2022-08-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen resolved SPARK-3. - Resolution: Won't Fix > Replace postgresql 42.3.3 with 42.2.26 > ---

[jira] [Assigned] (SPARK-40019) Refactor comment of ArrayType

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40019: Assignee: Apache Spark > Refactor comment of ArrayType > - >

[jira] [Assigned] (SPARK-40019) Refactor comment of ArrayType

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40019: Assignee: (was: Apache Spark) > Refactor comment of ArrayType > -

[jira] [Commented] (SPARK-40019) Refactor comment of ArrayType

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577429#comment-17577429 ] Apache Spark commented on SPARK-40019: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-40019) Refactor comment of ArrayType

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577432#comment-17577432 ] Apache Spark commented on SPARK-40019: -- User 'AngersZh' has created a pull requ

[jira] [Created] (SPARK-40020) centralize the code of qualifying identifiers in SessionCatalog

2022-08-09 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-40020: --- Summary: centralize the code of qualifying identifiers in SessionCatalog Key: SPARK-40020 URL: https://issues.apache.org/jira/browse/SPARK-40020 Project: Spark

[jira] [Assigned] (SPARK-40020) centralize the code of qualifying identifiers in SessionCatalog

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40020: Assignee: Apache Spark > centralize the code of qualifying identifiers in SessionCatalog

[jira] [Assigned] (SPARK-40020) centralize the code of qualifying identifiers in SessionCatalog

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40020: Assignee: (was: Apache Spark) > centralize the code of qualifying identifiers in Sess

[jira] [Commented] (SPARK-40020) centralize the code of qualifying identifiers in SessionCatalog

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577461#comment-17577461 ] Apache Spark commented on SPARK-40020: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-40020) centralize the code of qualifying identifiers in SessionCatalog

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577463#comment-17577463 ] Apache Spark commented on SPARK-40020: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-40021) `Cancel workflow` can not cancel some jobs

2022-08-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40021: - Summary: `Cancel workflow` can not cancel some jobs Key: SPARK-40021 URL: https://issues.apache.org/jira/browse/SPARK-40021 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs

2022-08-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577466#comment-17577466 ] Ruifeng Zheng commented on SPARK-40021: --- cc [~dongjoon] [~hyukjin.kwon] [~yikunker

[jira] [Updated] (SPARK-40021) `Cancel workflow` can not cancel some jobs

2022-08-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-40021: -- Attachment: Screen Shot 2022-08-09 at 22.35.00.png > `Cancel workflow` can not cancel some job

[jira] [Updated] (SPARK-40021) `Cancel workflow` can not cancel some jobs

2022-08-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-40021: -- Attachment: Screen Shot 2022-08-09 at 22.49.13.png > `Cancel workflow` can not cancel some job

[jira] [Updated] (SPARK-40021) `Cancel workflow` can not cancel some jobs

2022-08-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-40021: -- Attachment: (was: Screen Shot 2022-08-09 at 22.35.00.png) > `Cancel workflow` can not canc

[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs

2022-08-09 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577513#comment-17577513 ] Yikun Jiang commented on SPARK-40021: -   This might related to container-based job[

[jira] [Created] (SPARK-40022) YarnClusterSuite should not ABORTED there is no Python3 environment

2022-08-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-40022: Summary: YarnClusterSuite should not ABORTED there is no Python3 environment Key: SPARK-40022 URL: https://issues.apache.org/jira/browse/SPARK-40022 Project: Spark

[jira] [Updated] (SPARK-40022) YarnClusterSuite should not ABORTED when there is no Python3 environment

2022-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40022: - Summary: YarnClusterSuite should not ABORTED when there is no Python3 environment (was: YarnClusterSuit

[jira] [Commented] (SPARK-40022) YarnClusterSuite should not ABORTED when there is no Python3 environment

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577548#comment-17577548 ] Apache Spark commented on SPARK-40022: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40022) YarnClusterSuite should not ABORTED when there is no Python3 environment

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40022: Assignee: (was: Apache Spark) > YarnClusterSuite should not ABORTED when there is no

[jira] [Assigned] (SPARK-40022) YarnClusterSuite should not ABORTED when there is no Python3 environment

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40022: Assignee: Apache Spark > YarnClusterSuite should not ABORTED when there is no Python3 env

[jira] [Created] (SPARK-40023) Issue with Spark Core version 3.3.0

2022-08-09 Thread shamim (Jira)
shamim created SPARK-40023: -- Summary: Issue with Spark Core version 3.3.0 Key: SPARK-40023 URL: https://issues.apache.org/jira/browse/SPARK-40023 Project: Spark Issue Type: Bug Components

[jira] [Assigned] (SPARK-39989) Support estimate column statistics if it is foldable expression

2022-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39989: - Assignee: Yuming Wang > Support estimate column statistics if it is foldable expression

[jira] [Resolved] (SPARK-39989) Support estimate column statistics if it is foldable expression

2022-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39989. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37421 [https://

[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs

2022-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577604#comment-17577604 ] Dongjoon Hyun commented on SPARK-40021: --- Thank you for pinging me. I'm also not aw

[jira] [Created] (SPARK-40024) PostgresDialect Doesn't handle arrays of custom data types after postgresql driver version 42.2.22

2022-08-09 Thread Stephen Durfey (Jira)
Stephen Durfey created SPARK-40024: -- Summary: PostgresDialect Doesn't handle arrays of custom data types after postgresql driver version 42.2.22 Key: SPARK-40024 URL: https://issues.apache.org/jira/browse/SPARK-4

[jira] [Created] (SPARK-40025) Project Lightspeed (Spark Streaming Improvements)

2022-08-09 Thread Boyang Jerry Peng (Jira)
Boyang Jerry Peng created SPARK-40025: - Summary: Project Lightspeed (Spark Streaming Improvements) Key: SPARK-40025 URL: https://issues.apache.org/jira/browse/SPARK-40025 Project: Spark I

[jira] [Updated] (SPARK-40025) Project Lightspeed (Spark Streaming Improvements)

2022-08-09 Thread Boyang Jerry Peng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated SPARK-40025: -- Description: Umbrella Jira to track all tickets under Project Lightspeed SPARK-39585 

[jira] [Commented] (SPARK-39559) Support IPv6 in WebUI

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577665#comment-17577665 ] Apache Spark commented on SPARK-39559: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-40006) Make pyspark.sql.group examples self-contained

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577674#comment-17577674 ] Apache Spark commented on SPARK-40006: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-40006) Make pyspark.sql.group examples self-contained

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577676#comment-17577676 ] Apache Spark commented on SPARK-40006: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-39309) '_SubTest' object has no attribute 'elapsed_time'

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39309. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37448 [https://gi

[jira] [Assigned] (SPARK-39309) '_SubTest' object has no attribute 'elapsed_time'

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39309: Assignee: Yikun Jiang > '_SubTest' object has no attribute 'elapsed_time' > -

[jira] [Assigned] (SPARK-40015) Add sc.listArchives and sc.listFiles to PySpark

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40015: Assignee: Ruifeng Zheng > Add sc.listArchives and sc.listFiles to PySpark >

[jira] [Resolved] (SPARK-40015) Add sc.listArchives and sc.listFiles to PySpark

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40015. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37445 [https://gi

[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577683#comment-17577683 ] Hyukjin Kwon commented on SPARK-40021: -- I was thinking that it's more related to Gi

[jira] [Commented] (SPARK-39995) PySpark installation doesn't support Scala 2.13 binaries

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577686#comment-17577686 ] Hyukjin Kwon commented on SPARK-39995: -- It's good to have but I think we should bet

[jira] [Resolved] (SPARK-40022) YarnClusterSuite should not ABORTED when there is no Python3 environment

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40022. -- Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Assigned] (SPARK-40022) YarnClusterSuite should not ABORTED when there is no Python3 environment

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40022: Assignee: Yang Jie > YarnClusterSuite should not ABORTED when there is no Python3 environ

[jira] [Commented] (SPARK-40023) Issue with Spark Core version 3.3.0

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577692#comment-17577692 ] Hyukjin Kwon commented on SPARK-40023: -- It's likely related to how you set up the p

[jira] [Updated] (SPARK-40011) Pandas API on Spark requires Pandas

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40011: - Target Version/s: (was: 3.3.1) > Pandas API on Spark requires Pandas > ---

[jira] [Updated] (SPARK-40011) Pandas API on Spark requires Pandas

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40011: - Fix Version/s: (was: 3.3.1) > Pandas API on Spark requires Pandas >

[jira] [Resolved] (SPARK-40011) Pandas API on Spark requires Pandas

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40011. -- Resolution: Not A Problem > Pandas API on Spark requires Pandas >

[jira] [Commented] (SPARK-40011) Pandas API on Spark requires Pandas

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577693#comment-17577693 ] Hyukjin Kwon commented on SPARK-40011: -- Pandas API on Spark needs that because it r

[jira] [Updated] (SPARK-40005) Self-contained examples with parameter descriptions in PySpark documentation

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40005: - Priority: Critical (was: Major) > Self-contained examples with parameter descriptions in PySpar

[jira] [Resolved] (SPARK-40010) Make pyspark.sql.window examples self-contained

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40010. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37450 [https://gi

[jira] [Assigned] (SPARK-40010) Make pyspark.sql.window examples self-contained

2022-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40010: Assignee: Qian Sun > Make pyspark.sql.window examples self-contained > --

[jira] [Created] (SPARK-40026) spark-shell can not instantiate object whose class is defined in REPL dynamically

2022-08-09 Thread Kernel Force (Jira)
Kernel Force created SPARK-40026: Summary: spark-shell can not instantiate object whose class is defined in REPL dynamically Key: SPARK-40026 URL: https://issues.apache.org/jira/browse/SPARK-40026 Pro

[jira] [Created] (SPARK-40027) Make pyspark.sql.streaming.readwriter examples self-contained

2022-08-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-40027: Summary: Make pyspark.sql.streaming.readwriter examples self-contained Key: SPARK-40027 URL: https://issues.apache.org/jira/browse/SPARK-40027 Project: Spark

[jira] [Created] (SPARK-40028) Add binary examples for string expressions

2022-08-09 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-40028: -- Summary: Add binary examples for string expressions Key: SPARK-40028 URL: https://issues.apache.org/jira/browse/SPARK-40028 Project: Spark Issue Type: Documentat

[jira] [Assigned] (SPARK-40028) Add binary examples for string expressions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40028: Assignee: (was: Apache Spark) > Add binary examples for string expressions >

[jira] [Assigned] (SPARK-40028) Add binary examples for string expressions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40028: Assignee: Apache Spark > Add binary examples for string expressions > ---

[jira] [Commented] (SPARK-40028) Add binary examples for string expressions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577745#comment-17577745 ] Apache Spark commented on SPARK-40028: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-40028) Add binary examples for string expressions

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577746#comment-17577746 ] Apache Spark commented on SPARK-40028: -- User 'beliefer' has created a pull request

[jira] [Created] (SPARK-40029) Make pyspark.sql.types examples self-contained

2022-08-09 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40029: --- Summary: Make pyspark.sql.types examples self-contained Key: SPARK-40029 URL: https://issues.apache.org/jira/browse/SPARK-40029 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-40030) Upgrade scala-maven-plugin to 4.7.1

2022-08-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-40030: Summary: Upgrade scala-maven-plugin to 4.7.1 Key: SPARK-40030 URL: https://issues.apache.org/jira/browse/SPARK-40030 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-40030) Upgrade scala-maven-plugin to 4.7.1

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577769#comment-17577769 ] Apache Spark commented on SPARK-40030: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40030) Upgrade scala-maven-plugin to 4.7.1

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40030: Assignee: Apache Spark > Upgrade scala-maven-plugin to 4.7.1 > --

[jira] [Assigned] (SPARK-40030) Upgrade scala-maven-plugin to 4.7.1

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40030: Assignee: (was: Apache Spark) > Upgrade scala-maven-plugin to 4.7.1 > ---

[jira] [Updated] (SPARK-40016) Remove unnecessary TryEval in TrySum

2022-08-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40016: --- Parent: SPARK-35161 Issue Type: Sub-task (was: Task) > Remove unnecessary TryEval i

[jira] [Commented] (SPARK-40030) Upgrade scala-maven-plugin to 4.7.1

2022-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1750#comment-1750 ] Apache Spark commented on SPARK-40030: -- User 'LuciferYang' has created a pull reque

  1   2   >