Niranjan Jayakar created SPARK-42498:
Summary: reduce spark connect service retry time
Key: SPARK-42498
URL: https://issues.apache.org/jira/browse/SPARK-42498
Project: Spark
Issue Type:
Haejoon Lee created SPARK-42497:
---
Summary: Basic support of pandas API on Spark for Spark Connect.
Key: SPARK-42497
URL: https://issues.apache.org/jira/browse/SPARK-42497
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-42497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691018#comment-17691018
]
Haejoon Lee commented on SPARK-42497:
-
I'm working on this.
Will submit a PR soon.
> Basic support
[
https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691017#comment-17691017
]
Haejoon Lee commented on SPARK-42496:
-
I'm working on it.
> Introduction Spark Connect at main
Haejoon Lee created SPARK-42496:
---
Summary: Introduction Spark Connect at main page.
Key: SPARK-42496
URL: https://issues.apache.org/jira/browse/SPARK-42496
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-42475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42475:
Assignee: (was: Apache Spark)
> Getting Started: Live Notebook for Spark Connect
>
[
https://issues.apache.org/jira/browse/SPARK-42475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691016#comment-17691016
]
Apache Spark commented on SPARK-42475:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42475:
Assignee: Apache Spark
> Getting Started: Live Notebook for Spark Connect
>
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41952:
Assignee: Apache Spark
> Upgrade Parquet to fix off-heap memory leaks in Zstd codec
>
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691015#comment-17691015
]
Apache Spark commented on SPARK-41952:
--
User 'pan3793' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41952:
Assignee: (was: Apache Spark)
> Upgrade Parquet to fix off-heap memory leaks in Zstd
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691014#comment-17691014
]
Dongjoon Hyun commented on SPARK-41952:
---
May I ask why you put me `Shepherd` field,
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-41952:
--
Shepherd: (was: Dongjoon Hyun)
> Upgrade Parquet to fix off-heap memory leaks in Zstd codec
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691012#comment-17691012
]
Cheng Pan commented on SPARK-41952:
---
Fix on Spark side is feasible, I'm working on this.
> Upgrade
[
https://issues.apache.org/jira/browse/SPARK-42286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-42286:
---
Fix Version/s: 3.4.0
Assignee: Runyao.Chen
> Fix internal error for valid CASE
[
https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691011#comment-17691011
]
Yuming Wang commented on SPARK-42473:
-
It seems we should backport
[
https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41741:
Assignee: (was: Apache Spark)
> [SQL] ParquetFilters StringStartsWith push down
[
https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41741:
Assignee: Apache Spark
> [SQL] ParquetFilters StringStartsWith push down matching string
[
https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691010#comment-17691010
]
Apache Spark commented on SPARK-41741:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42488:
-
Assignee: Yang Jie
> Upgrade commons-crypto from 1.1.0 to 1.2.0
>
[
https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42488.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40082
[
https://issues.apache.org/jira/browse/SPARK-42495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691001#comment-17691001
]
Apache Spark commented on SPARK-42495:
--
User 'hvanhovell' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42495:
Assignee: Herman van Hövell (was: Apache Spark)
> Scala Client: Add 2nd batch of
[
https://issues.apache.org/jira/browse/SPARK-42495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42495:
Assignee: Apache Spark (was: Herman van Hövell)
> Scala Client: Add 2nd batch of
[
https://issues.apache.org/jira/browse/SPARK-42495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691002#comment-17691002
]
Apache Spark commented on SPARK-42495:
--
User 'hvanhovell' has created a pull request for this
Herman van Hövell created SPARK-42495:
-
Summary: Scala Client: Add 2nd batch of functions
Key: SPARK-42495
URL: https://issues.apache.org/jira/browse/SPARK-42495
Project: Spark
Issue
Yikun Jiang created SPARK-42494:
---
Summary: Add official image Dockerfile for Spark v3.3.2
Key: SPARK-42494
URL: https://issues.apache.org/jira/browse/SPARK-42494
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-42467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690997#comment-17690997
]
Herman van Hövell commented on SPARK-42467:
---
Small reminder please add tests for
[
https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allan Folting updated SPARK-42493:
--
Summary: Spark SQL, DataFrames and Datasets Guide - make Python the first
code example tab
[
https://issues.apache.org/jira/browse/SPARK-38427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690971#comment-17690971
]
Jackey Lee commented on SPARK-38427:
[~LuciferYang]
> DataFilter pushed down with PartitionFilter
[ https://issues.apache.org/jira/browse/SPARK-38427 ]
Jackey Lee deleted comment on SPARK-38427:
was (Author: jackey lee):
[~LuciferYang]
> DataFilter pushed down with PartitionFilter for Orc
>
[
https://issues.apache.org/jira/browse/SPARK-42427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690970#comment-17690970
]
Apache Spark commented on SPARK-42427:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690969#comment-17690969
]
Jackey Lee commented on SPARK-38427:
[~LuciferYang]
> DataFilter pushed down with PartitionFilter
[
https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690965#comment-17690965
]
kevinshin edited comment on SPARK-42473 at 2/20/23 1:47 AM:
[~yumwang]
[
https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690965#comment-17690965
]
kevinshin commented on SPARK-42473:
---
[~yumwang] 'What is your test.spark33_decimal_orc column type?'
[
https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-42493:
--
Affects Version/s: 3.5.0
(was: 3.4.0)
> Spark SQL, DataFrames and
[
https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42493:
Assignee: (was: Apache Spark)
> Spark SQL, DataFrames and Datasets Guide - make
[
https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690958#comment-17690958
]
Apache Spark commented on SPARK-42493:
--
User 'allanf-db' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42493:
Assignee: Apache Spark
> Spark SQL, DataFrames and Datasets Guide - make Python the
[
https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42487:
-
Assignee: Yang Jie
> Upgrade Netty to 4.1.89
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42487.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 40081
Allan Folting created SPARK-42493:
-
Summary: Spark SQL, DataFrames and Datasets Guide - make Python
the first example tab
Key: SPARK-42493
URL: https://issues.apache.org/jira/browse/SPARK-42493
[
https://issues.apache.org/jira/browse/SPARK-42048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-42048:
Assignee: Takuya Ueshin
> Different column name of lit(np.int8)
>
[
https://issues.apache.org/jira/browse/SPARK-42048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-42048.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 40076
[
https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690947#comment-17690947
]
Mich Talebzadeh commented on SPARK-42485:
-
done thanks
> SPIP: Shutting down spark structured
[
https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mich Talebzadeh updated SPARK-42485:
Affects Version/s: 3.2.2
> SPIP: Shutting down spark structured streaming when the
[
https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mich Talebzadeh updated SPARK-42485:
Affects Version/s: (was: 3.3.2)
> SPIP: Shutting down spark structured streaming when
[
https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690944#comment-17690944
]
Dongjoon Hyun commented on SPARK-42485:
---
Thank you for the removal of Target Version. The
[
https://issues.apache.org/jira/browse/SPARK-42482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-42482.
---
Fix Version/s: 3.4.0
Resolution: Fixed
> Scala client Write API V1
>
[
https://issues.apache.org/jira/browse/SPARK-42492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42492:
Assignee: Apache Spark
> Add new function filter_value
> -
>
[
https://issues.apache.org/jira/browse/SPARK-42492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690894#comment-17690894
]
Apache Spark commented on SPARK-42492:
--
User 'Kimahriman' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42492:
Assignee: (was: Apache Spark)
> Add new function filter_value
>
[
https://issues.apache.org/jira/browse/SPARK-42492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adam Binford updated SPARK-42492:
-
Description:
Doing data validation in Spark can lead to a lot of extra evaluations of
Adam Binford created SPARK-42492:
Summary: Add new function filter_value
Key: SPARK-42492
URL: https://issues.apache.org/jira/browse/SPARK-42492
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690879#comment-17690879
]
Apache Spark commented on SPARK-42490:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690878#comment-17690878
]
Apache Spark commented on SPARK-42487:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42490:
Assignee: Apache Spark
> Upgrade protobuf-java to 3.22.0
>
[
https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690877#comment-17690877
]
Yang Jie commented on SPARK-42491:
--
it has not been published to the central repository
> Upgrade
[
https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42490:
Assignee: (was: Apache Spark)
> Upgrade protobuf-java to 3.22.0
>
[
https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42487:
Assignee: (was: Apache Spark)
> Upgrade Netty to 4.1.89
> ---
>
[
https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42487:
Assignee: Apache Spark
> Upgrade Netty to 4.1.89
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690876#comment-17690876
]
Apache Spark commented on SPARK-42490:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42489:
Assignee: Apache Spark
> Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0
>
[
https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42489:
Assignee: (was: Apache Spark)
> Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0
[
https://issues.apache.org/jira/browse/SPARK-42489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690875#comment-17690875
]
Apache Spark commented on SPARK-42489:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42488:
Assignee: (was: Apache Spark)
> Upgrade commons-crypto from 1.1.0 to 1.2.0
>
[
https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42488:
Assignee: Apache Spark
> Upgrade commons-crypto from 1.1.0 to 1.2.0
>
[
https://issues.apache.org/jira/browse/SPARK-42488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690874#comment-17690874
]
Apache Spark commented on SPARK-42488:
--
User 'LuciferYang' has created a pull request for this
Yang Jie created SPARK-42491:
Summary: Upgrade jetty to 9.4.51.v20230217
Key: SPARK-42491
URL: https://issues.apache.org/jira/browse/SPARK-42491
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42491:
-
Description:
https://github.com/eclipse/jetty.project/releases/tag/jetty-9.4.51.v20230217
> Upgrade
[
https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42490:
-
Description: https://github.com/protocolbuffers/protobuf/releases/tag/v22.0
> Upgrade protobuf-java to
Yang Jie created SPARK-42490:
Summary: Upgrade protobuf-java to 3.22.0
Key: SPARK-42490
URL: https://issues.apache.org/jira/browse/SPARK-42490
Project: Spark
Issue Type: Improvement
Yang Jie created SPARK-42489:
Summary: Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0
Key: SPARK-42489
URL: https://issues.apache.org/jira/browse/SPARK-42489
Project: Spark
Issue Type:
Yang Jie created SPARK-42488:
Summary: Upgrade commons-crypto from 1.1.0 to 1.2.0
Key: SPARK-42488
URL: https://issues.apache.org/jira/browse/SPARK-42488
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42487:
-
Summary: Upgrade Netty to 4.1.89 (was: Upgrade Netty from 4.1.89)
> Upgrade Netty to 4.1.89
>
Yang Jie created SPARK-42487:
Summary: Upgrade Netty from 4.1.89
Key: SPARK-42487
URL: https://issues.apache.org/jira/browse/SPARK-42487
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-42323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-42323.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 39977
[
https://issues.apache.org/jira/browse/SPARK-42323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-42323:
Assignee: Haejoon Lee
> Assign name to _LEGACY_ERROR_TEMP_2332
>
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690853#comment-17690853
]
Yang Jie edited comment on SPARK-41952 at 2/19/23 8:54 AM:
---
For the old Spark
[
https://issues.apache.org/jira/browse/SPARK-41952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690853#comment-17690853
]
Yang Jie commented on SPARK-41952:
--
For the old Spark versions, is it possible to introduce other costs
[
https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690847#comment-17690847
]
Mich Talebzadeh commented on SPARK-42485:
-
How about Target Version?
> SPIP: Shutting down
[
https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mich Talebzadeh updated SPARK-42485:
Target Version/s: (was: 3.3.2)
> SPIP: Shutting down spark structured streaming when
82 matches
Mail list logo