[jira] [Created] (SPARK-42498) reduce spark connect service retry time

2023-02-19 Thread Niranjan Jayakar (Jira)
Niranjan Jayakar created SPARK-42498: Summary: reduce spark connect service retry time Key: SPARK-42498 URL: https://issues.apache.org/jira/browse/SPARK-42498 Project: Spark Issue Type:

[jira] [Created] (SPARK-42497) Basic support of pandas API on Spark for Spark Connect.

2023-02-19 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-42497: --- Summary: Basic support of pandas API on Spark for Spark Connect. Key: SPARK-42497 URL: https://issues.apache.org/jira/browse/SPARK-42497 Project: Spark Issue

[jira] [Commented] (SPARK-42497) Basic support of pandas API on Spark for Spark Connect.

2023-02-19 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691018#comment-17691018 ] Haejoon Lee commented on SPARK-42497: - I'm working on this. Will submit a PR soon. > Basic support

[jira] [Commented] (SPARK-42496) Introduction Spark Connect at main page.

2023-02-19 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691017#comment-17691017 ] Haejoon Lee commented on SPARK-42496: - I'm working on it. > Introduction Spark Connect at main

[jira] [Created] (SPARK-42496) Introduction Spark Connect at main page.

2023-02-19 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-42496: --- Summary: Introduction Spark Connect at main page. Key: SPARK-42496 URL: https://issues.apache.org/jira/browse/SPARK-42496 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-42475) Getting Started: Live Notebook for Spark Connect

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42475: Assignee: (was: Apache Spark) > Getting Started: Live Notebook for Spark Connect >

[jira] [Commented] (SPARK-42475) Getting Started: Live Notebook for Spark Connect

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691016#comment-17691016 ] Apache Spark commented on SPARK-42475: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42475) Getting Started: Live Notebook for Spark Connect

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42475: Assignee: Apache Spark > Getting Started: Live Notebook for Spark Connect >

[jira] [Assigned] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41952: Assignee: Apache Spark > Upgrade Parquet to fix off-heap memory leaks in Zstd codec >

[jira] [Commented] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691015#comment-17691015 ] Apache Spark commented on SPARK-41952: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41952: Assignee: (was: Apache Spark) > Upgrade Parquet to fix off-heap memory leaks in Zstd

[jira] [Commented] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

2023-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691014#comment-17691014 ] Dongjoon Hyun commented on SPARK-41952: --- May I ask why you put me `Shepherd` field,

[jira] [Updated] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

2023-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41952: -- Shepherd: (was: Dongjoon Hyun) > Upgrade Parquet to fix off-heap memory leaks in Zstd codec

[jira] [Commented] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

2023-02-19 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691012#comment-17691012 ] Cheng Pan commented on SPARK-41952: --- Fix on Spark side is feasible, I'm working on this. > Upgrade

[jira] [Assigned] (SPARK-42286) Fix internal error for valid CASE WHEN expression with CAST when inserting into a table

2023-02-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-42286: --- Fix Version/s: 3.4.0 Assignee: Runyao.Chen > Fix internal error for valid CASE

[jira] [Commented] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

2023-02-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691011#comment-17691011 ] Yuming Wang commented on SPARK-42473: - It seems we should backport

[jira] [Assigned] (SPARK-41741) [SQL] ParquetFilters StringStartsWith push down matching string do not use UTF-8

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41741: Assignee: (was: Apache Spark) > [SQL] ParquetFilters StringStartsWith push down

[jira] [Assigned] (SPARK-41741) [SQL] ParquetFilters StringStartsWith push down matching string do not use UTF-8

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41741: Assignee: Apache Spark > [SQL] ParquetFilters StringStartsWith push down matching string

[jira] [Commented] (SPARK-41741) [SQL] ParquetFilters StringStartsWith push down matching string do not use UTF-8

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691010#comment-17691010 ] Apache Spark commented on SPARK-41741: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42488) Upgrade commons-crypto from 1.1.0 to 1.2.0

2023-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42488: - Assignee: Yang Jie > Upgrade commons-crypto from 1.1.0 to 1.2.0 >

[jira] [Resolved] (SPARK-42488) Upgrade commons-crypto from 1.1.0 to 1.2.0

2023-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42488. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40082

[jira] [Commented] (SPARK-42495) Scala Client: Add 2nd batch of functions

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691001#comment-17691001 ] Apache Spark commented on SPARK-42495: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42495) Scala Client: Add 2nd batch of functions

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42495: Assignee: Herman van Hövell (was: Apache Spark) > Scala Client: Add 2nd batch of

[jira] [Assigned] (SPARK-42495) Scala Client: Add 2nd batch of functions

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42495: Assignee: Apache Spark (was: Herman van Hövell) > Scala Client: Add 2nd batch of

[jira] [Commented] (SPARK-42495) Scala Client: Add 2nd batch of functions

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691002#comment-17691002 ] Apache Spark commented on SPARK-42495: -- User 'hvanhovell' has created a pull request for this

[jira] [Created] (SPARK-42495) Scala Client: Add 2nd batch of functions

2023-02-19 Thread Jira
Herman van Hövell created SPARK-42495: - Summary: Scala Client: Add 2nd batch of functions Key: SPARK-42495 URL: https://issues.apache.org/jira/browse/SPARK-42495 Project: Spark Issue

[jira] [Created] (SPARK-42494) Add official image Dockerfile for Spark v3.3.2

2023-02-19 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-42494: --- Summary: Add official image Dockerfile for Spark v3.3.2 Key: SPARK-42494 URL: https://issues.apache.org/jira/browse/SPARK-42494 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42467) Spark Connect Scala Client: GroupBy and Aggregation

2023-02-19 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690997#comment-17690997 ] Herman van Hövell commented on SPARK-42467: --- Small reminder please add tests for

[jira] [Updated] (SPARK-42493) Spark SQL, DataFrames and Datasets Guide - make Python the first code example tab

2023-02-19 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42493: -- Summary: Spark SQL, DataFrames and Datasets Guide - make Python the first code example tab

[jira] [Commented] (SPARK-38427) DataFilter pushed down with PartitionFilter for Orc

2023-02-19 Thread Jackey Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690971#comment-17690971 ] Jackey Lee commented on SPARK-38427: [~LuciferYang]  > DataFilter pushed down with PartitionFilter

[jira] (SPARK-38427) DataFilter pushed down with PartitionFilter for Orc

2023-02-19 Thread Jackey Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38427 ] Jackey Lee deleted comment on SPARK-38427: was (Author: jackey lee): [~LuciferYang]  > DataFilter pushed down with PartitionFilter for Orc >

[jira] [Commented] (SPARK-42427) Conv should return an error if the internal conversion overflows

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690970#comment-17690970 ] Apache Spark commented on SPARK-42427: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-38427) DataFilter pushed down with PartitionFilter for Orc

2023-02-19 Thread Jackey Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690969#comment-17690969 ] Jackey Lee commented on SPARK-38427: [~LuciferYang]  > DataFilter pushed down with PartitionFilter

[jira] [Comment Edited] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

2023-02-19 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690965#comment-17690965 ] kevinshin edited comment on SPARK-42473 at 2/20/23 1:47 AM: [~yumwang] 

[jira] [Commented] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

2023-02-19 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690965#comment-17690965 ] kevinshin commented on SPARK-42473: --- [~yumwang]  'What is your test.spark33_decimal_orc column type?'

[jira] [Updated] (SPARK-42493) Spark SQL, DataFrames and Datasets Guide - make Python the first example tab

2023-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42493: -- Affects Version/s: 3.5.0 (was: 3.4.0) > Spark SQL, DataFrames and

[jira] [Assigned] (SPARK-42493) Spark SQL, DataFrames and Datasets Guide - make Python the first example tab

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42493: Assignee: (was: Apache Spark) > Spark SQL, DataFrames and Datasets Guide - make

[jira] [Commented] (SPARK-42493) Spark SQL, DataFrames and Datasets Guide - make Python the first example tab

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690958#comment-17690958 ] Apache Spark commented on SPARK-42493: -- User 'allanf-db' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42493) Spark SQL, DataFrames and Datasets Guide - make Python the first example tab

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42493: Assignee: Apache Spark > Spark SQL, DataFrames and Datasets Guide - make Python the

[jira] [Assigned] (SPARK-42487) Upgrade Netty to 4.1.89

2023-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42487: - Assignee: Yang Jie > Upgrade Netty to 4.1.89 > --- > >

[jira] [Resolved] (SPARK-42487) Upgrade Netty to 4.1.89

2023-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42487. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40081

[jira] [Created] (SPARK-42493) Spark SQL, DataFrames and Datasets Guide - make Python the first example tab

2023-02-19 Thread Allan Folting (Jira)
Allan Folting created SPARK-42493: - Summary: Spark SQL, DataFrames and Datasets Guide - make Python the first example tab Key: SPARK-42493 URL: https://issues.apache.org/jira/browse/SPARK-42493

[jira] [Assigned] (SPARK-42048) Different column name of lit(np.int8)

2023-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42048: Assignee: Takuya Ueshin > Different column name of lit(np.int8) >

[jira] [Resolved] (SPARK-42048) Different column name of lit(np.int8)

2023-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42048. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40076

[jira] [Commented] (SPARK-42485) SPIP: Shutting down spark structured streaming when the streaming process completed current process

2023-02-19 Thread Mich Talebzadeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690947#comment-17690947 ] Mich Talebzadeh commented on SPARK-42485: - done thanks > SPIP: Shutting down spark structured

[jira] [Updated] (SPARK-42485) SPIP: Shutting down spark structured streaming when the streaming process completed current process

2023-02-19 Thread Mich Talebzadeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mich Talebzadeh updated SPARK-42485: Affects Version/s: 3.2.2 > SPIP: Shutting down spark structured streaming when the

[jira] [Updated] (SPARK-42485) SPIP: Shutting down spark structured streaming when the streaming process completed current process

2023-02-19 Thread Mich Talebzadeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mich Talebzadeh updated SPARK-42485: Affects Version/s: (was: 3.3.2) > SPIP: Shutting down spark structured streaming when

[jira] [Commented] (SPARK-42485) SPIP: Shutting down spark structured streaming when the streaming process completed current process

2023-02-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690944#comment-17690944 ] Dongjoon Hyun commented on SPARK-42485: --- Thank you for the removal of Target Version. The

[jira] [Resolved] (SPARK-42482) Scala client Write API V1

2023-02-19 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42482. --- Fix Version/s: 3.4.0 Resolution: Fixed > Scala client Write API V1 >

[jira] [Assigned] (SPARK-42492) Add new function filter_value

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42492: Assignee: Apache Spark > Add new function filter_value > - >

[jira] [Commented] (SPARK-42492) Add new function filter_value

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690894#comment-17690894 ] Apache Spark commented on SPARK-42492: -- User 'Kimahriman' has created a pull request for this

[jira] [Assigned] (SPARK-42492) Add new function filter_value

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42492: Assignee: (was: Apache Spark) > Add new function filter_value >

[jira] [Updated] (SPARK-42492) Add new function filter_value

2023-02-19 Thread Adam Binford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Binford updated SPARK-42492: - Description: Doing data validation in Spark can lead to a lot of extra evaluations of

[jira] [Created] (SPARK-42492) Add new function filter_value

2023-02-19 Thread Adam Binford (Jira)
Adam Binford created SPARK-42492: Summary: Add new function filter_value Key: SPARK-42492 URL: https://issues.apache.org/jira/browse/SPARK-42492 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-42490) Upgrade protobuf-java to 3.22.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690879#comment-17690879 ] Apache Spark commented on SPARK-42490: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42487) Upgrade Netty to 4.1.89

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690878#comment-17690878 ] Apache Spark commented on SPARK-42487: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42490) Upgrade protobuf-java to 3.22.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42490: Assignee: Apache Spark > Upgrade protobuf-java to 3.22.0 >

[jira] [Commented] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690877#comment-17690877 ] Yang Jie commented on SPARK-42491: -- it has not been published to the central repository > Upgrade

[jira] [Assigned] (SPARK-42490) Upgrade protobuf-java to 3.22.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42490: Assignee: (was: Apache Spark) > Upgrade protobuf-java to 3.22.0 >

[jira] [Assigned] (SPARK-42487) Upgrade Netty to 4.1.89

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42487: Assignee: (was: Apache Spark) > Upgrade Netty to 4.1.89 > --- >

[jira] [Assigned] (SPARK-42487) Upgrade Netty to 4.1.89

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42487: Assignee: Apache Spark > Upgrade Netty to 4.1.89 > --- > >

[jira] [Commented] (SPARK-42490) Upgrade protobuf-java to 3.22.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690876#comment-17690876 ] Apache Spark commented on SPARK-42490: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42489) Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42489: Assignee: Apache Spark > Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0 >

[jira] [Assigned] (SPARK-42489) Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42489: Assignee: (was: Apache Spark) > Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0

[jira] [Commented] (SPARK-42489) Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690875#comment-17690875 ] Apache Spark commented on SPARK-42489: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42488) Upgrade commons-crypto from 1.1.0 to 1.2.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42488: Assignee: (was: Apache Spark) > Upgrade commons-crypto from 1.1.0 to 1.2.0 >

[jira] [Assigned] (SPARK-42488) Upgrade commons-crypto from 1.1.0 to 1.2.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42488: Assignee: Apache Spark > Upgrade commons-crypto from 1.1.0 to 1.2.0 >

[jira] [Commented] (SPARK-42488) Upgrade commons-crypto from 1.1.0 to 1.2.0

2023-02-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690874#comment-17690874 ] Apache Spark commented on SPARK-42488: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

2023-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42491: Summary: Upgrade jetty to 9.4.51.v20230217 Key: SPARK-42491 URL: https://issues.apache.org/jira/browse/SPARK-42491 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42491: - Description: https://github.com/eclipse/jetty.project/releases/tag/jetty-9.4.51.v20230217 > Upgrade

[jira] [Updated] (SPARK-42490) Upgrade protobuf-java to 3.22.0

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42490: - Description: https://github.com/protocolbuffers/protobuf/releases/tag/v22.0 > Upgrade protobuf-java to

[jira] [Created] (SPARK-42490) Upgrade protobuf-java to 3.22.0

2023-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42490: Summary: Upgrade protobuf-java to 3.22.0 Key: SPARK-42490 URL: https://issues.apache.org/jira/browse/SPARK-42490 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42489) Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0

2023-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42489: Summary: Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0 Key: SPARK-42489 URL: https://issues.apache.org/jira/browse/SPARK-42489 Project: Spark Issue Type:

[jira] [Created] (SPARK-42488) Upgrade commons-crypto from 1.1.0 to 1.2.0

2023-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42488: Summary: Upgrade commons-crypto from 1.1.0 to 1.2.0 Key: SPARK-42488 URL: https://issues.apache.org/jira/browse/SPARK-42488 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42487) Upgrade Netty to 4.1.89

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42487: - Summary: Upgrade Netty to 4.1.89 (was: Upgrade Netty from 4.1.89) > Upgrade Netty to 4.1.89 >

[jira] [Created] (SPARK-42487) Upgrade Netty from 4.1.89

2023-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42487: Summary: Upgrade Netty from 4.1.89 Key: SPARK-42487 URL: https://issues.apache.org/jira/browse/SPARK-42487 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-42323) Assign name to _LEGACY_ERROR_TEMP_2332

2023-02-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42323. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39977

[jira] [Assigned] (SPARK-42323) Assign name to _LEGACY_ERROR_TEMP_2332

2023-02-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42323: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_2332 >

[jira] [Comment Edited] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690853#comment-17690853 ] Yang Jie edited comment on SPARK-41952 at 2/19/23 8:54 AM: --- For the old Spark

[jira] [Commented] (SPARK-41952) Upgrade Parquet to fix off-heap memory leaks in Zstd codec

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690853#comment-17690853 ] Yang Jie commented on SPARK-41952: -- For the old Spark versions, is it possible to introduce other costs

[jira] [Commented] (SPARK-42485) SPIP: Shutting down spark structured streaming when the streaming process completed current process

2023-02-19 Thread Mich Talebzadeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690847#comment-17690847 ] Mich Talebzadeh commented on SPARK-42485: - How about Target Version? > SPIP: Shutting down

[jira] [Updated] (SPARK-42485) SPIP: Shutting down spark structured streaming when the streaming process completed current process

2023-02-19 Thread Mich Talebzadeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mich Talebzadeh updated SPARK-42485: Target Version/s: (was: 3.3.2) > SPIP: Shutting down spark structured streaming when