[
https://issues.apache.org/jira/browse/SPARK-42153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-42153.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39696
[
https://issues.apache.org/jira/browse/SPARK-42149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-42149.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-42149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-42149:
---
Assignee: Yang Jie
> Remove the env `SPARK_USE_CONC_INCR_GC` used to
[
https://issues.apache.org/jira/browse/SPARK-42146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-42146:
--
Assignee: Yang Jie
> Refactor `Utils#setStringField` to make maven build pass when
[
https://issues.apache.org/jira/browse/SPARK-42146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-42146:
-
Priority: Trivial (was: Major)
> Refactor `Utils#setStringField` to make maven build pass when
[
https://issues.apache.org/jira/browse/SPARK-42146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-42146.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39688
[
https://issues.apache.org/jira/browse/SPARK-41772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679508#comment-17679508
]
Apache Spark commented on SPARK-41772:
--
User 'zhengruifeng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-41772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41772:
Assignee: (was: Apache Spark)
> Enable pyspark.sql.connect.column.Column.withField
[
https://issues.apache.org/jira/browse/SPARK-41772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41772:
Assignee: Apache Spark
> Enable pyspark.sql.connect.column.Column.withField doctest
>
[
https://issues.apache.org/jira/browse/SPARK-41772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679507#comment-17679507
]
Apache Spark commented on SPARK-41772:
--
User 'zhengruifeng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-41283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41283:
Assignee: Apache Spark (was: Ruifeng Zheng)
> Feature parity: Functions API in Spark
[
https://issues.apache.org/jira/browse/SPARK-41283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41283:
Assignee: Ruifeng Zheng (was: Apache Spark)
> Feature parity: Functions API in Spark
[
https://issues.apache.org/jira/browse/SPARK-41283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679502#comment-17679502
]
Apache Spark commented on SPARK-41283:
--
User 'zhengruifeng' has created a pull request for this
Ruifeng Zheng created SPARK-42155:
-
Summary: Add `array_append` to Connect
Key: SPARK-42155
URL: https://issues.apache.org/jira/browse/SPARK-42155
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-42154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679497#comment-17679497
]
Apache Spark commented on SPARK-42154:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42154:
Assignee: (was: Apache Spark)
> Enable Volcano unit tests and integration tests in
[
https://issues.apache.org/jira/browse/SPARK-42154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679496#comment-17679496
]
Apache Spark commented on SPARK-42154:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42154:
Assignee: Apache Spark
> Enable Volcano unit tests and integration tests in GitHub
Dongjoon Hyun created SPARK-42154:
-
Summary: Enable Volcano unit tests and integration tests in GitHub
Action
Key: SPARK-42154
URL: https://issues.apache.org/jira/browse/SPARK-42154
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42150.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39690
[
https://issues.apache.org/jira/browse/SPARK-42150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42150:
-
Assignee: Dongjoon Hyun
> Upgrade Volcano to 1.7.0
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-42153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42153:
Assignee: Apache Spark (was: Gengliang Wang)
> Handle null string values in
>
[
https://issues.apache.org/jira/browse/SPARK-42153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42153:
Assignee: Gengliang Wang (was: Apache Spark)
> Handle null string values in
>
[
https://issues.apache.org/jira/browse/SPARK-42153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679494#comment-17679494
]
Apache Spark commented on SPARK-42153:
--
User 'gengliangwang' has created a pull request for this
Gengliang Wang created SPARK-42153:
--
Summary: Handle null string values in
PairStrings/RDDOperationNode/RDDOperationClusterWrapper
Key: SPARK-42153
URL: https://issues.apache.org/jira/browse/SPARK-42153
[
https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-42140:
--
Assignee: Yang Jie
> Handle null string values in
>
[
https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-42140.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39684
[
https://issues.apache.org/jira/browse/SPARK-42142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42142.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39685
[
https://issues.apache.org/jira/browse/SPARK-42143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42143.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39686
[
https://issues.apache.org/jira/browse/SPARK-42117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen resolved SPARK-42117.
-
Resolution: Duplicate
> Upgrade kubernetes-client from 6.3.1 to 6.4.0
>
[
https://issues.apache.org/jira/browse/SPARK-42148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42148.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39689
[
https://issues.apache.org/jira/browse/SPARK-42148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42148:
-
Assignee: Dongjoon Hyun
> Upgrade `kubernetes-client` to 6.4.0
>
[
https://issues.apache.org/jira/browse/SPARK-42152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42152:
Assignee: (was: Apache Spark)
> Use `_` instead of `-` in `shadedPattern` for
[
https://issues.apache.org/jira/browse/SPARK-42152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679471#comment-17679471
]
Apache Spark commented on SPARK-42152:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42152:
Assignee: Apache Spark
> Use `_` instead of `-` in `shadedPattern` for relocation
Yang Jie created SPARK-42152:
Summary: Use `_` instead of `-` in `shadedPattern` for relocation
package name
Key: SPARK-42152
URL: https://issues.apache.org/jira/browse/SPARK-42152
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-41712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679466#comment-17679466
]
Apache Spark commented on SPARK-41712:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-41712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41712:
Assignee: (was: Apache Spark)
> Migrate the Spark Connect errors into PySpark error
[
https://issues.apache.org/jira/browse/SPARK-41712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679465#comment-17679465
]
Apache Spark commented on SPARK-41712:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-41712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41712:
Assignee: Apache Spark
> Migrate the Spark Connect errors into PySpark error framework.
[
https://issues.apache.org/jira/browse/SPARK-35801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679464#comment-17679464
]
Anton Okolnychyi commented on SPARK-35801:
--
We should probably keep it open even beyond 3.4 as
Anton Okolnychyi created SPARK-42151:
Summary: Align UPDATE assignments with table attributes
Key: SPARK-42151
URL: https://issues.apache.org/jira/browse/SPARK-42151
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-41712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-41712:
Description: We need to migrate the Spark Connect errors into centralized
error framework for
[
https://issues.apache.org/jira/browse/SPARK-41712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-41712:
Summary: Migrate the Spark Connect errors into PySpark error framework.
(was: Migrate the Spark
[
https://issues.apache.org/jira/browse/SPARK-42147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-42147.
--
Resolution: Won't Fix
> Restore the signature of Utils#setStringField to `setStringField(input:
>
[
https://issues.apache.org/jira/browse/SPARK-41629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679460#comment-17679460
]
Apache Spark commented on SPARK-41629:
--
User 'grundprinzip' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-41629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679459#comment-17679459
]
Apache Spark commented on SPARK-41629:
--
User 'grundprinzip' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679458#comment-17679458
]
Apache Spark commented on SPARK-31561:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679457#comment-17679457
]
Apache Spark commented on SPARK-31561:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-42150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679456#comment-17679456
]
Apache Spark commented on SPARK-42150:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42150:
Assignee: Apache Spark
> Upgrade Volcano to 1.7.0
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-42150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42150:
Assignee: (was: Apache Spark)
> Upgrade Volcano to 1.7.0
>
[
https://issues.apache.org/jira/browse/SPARK-42150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679455#comment-17679455
]
Apache Spark commented on SPARK-42150:
--
User 'dongjoon-hyun' has created a pull request for this
Dongjoon Hyun created SPARK-42150:
-
Summary: Upgrade Volcano to 1.7.0
Key: SPARK-42150
URL: https://issues.apache.org/jira/browse/SPARK-42150
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-41683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-41683.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39190
[
https://issues.apache.org/jira/browse/SPARK-41683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-41683:
Assignee: wy
> Spark UI: In jobs API, numActiveStages can be negative in some cases
>
[
https://issues.apache.org/jira/browse/SPARK-41598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-41598.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39638
[
https://issues.apache.org/jira/browse/SPARK-41598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-41598:
Assignee: Haejoon Lee
> Migrate the errors from `pyspark/sql/functions.py` into error
[
https://issues.apache.org/jira/browse/SPARK-42082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-42082:
Assignee: Haejoon Lee
> Introduce `PySparkValueError` and `PySparkTypeError`
>
[
https://issues.apache.org/jira/browse/SPARK-42082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-42082.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39638
[ https://issues.apache.org/jira/browse/SPARK-41470 ]
Mars deleted comment on SPARK-41470:
--
was (Author: JIRAUSER290821):
[~csun] I want to fix it ~
> SPJ: Spark shouldn't assume InternalRow implements equals and hashCode
>
[
https://issues.apache.org/jira/browse/SPARK-42149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42149:
Assignee: Apache Spark
> Remove the env `SPARK_USE_CONC_INCR_GC` used to enable CMS GC
[
https://issues.apache.org/jira/browse/SPARK-42149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42149:
Assignee: (was: Apache Spark)
> Remove the env `SPARK_USE_CONC_INCR_GC` used to
Yang Jie created SPARK-42149:
Summary: Remove the env `SPARK_USE_CONC_INCR_GC` used to enable
CMS GC for Yarn AM
Key: SPARK-42149
URL: https://issues.apache.org/jira/browse/SPARK-42149
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42148:
Assignee: Apache Spark
> Upgrade `kubernetes-client` to 6.4.0
>
[
https://issues.apache.org/jira/browse/SPARK-42148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42148:
Assignee: (was: Apache Spark)
> Upgrade `kubernetes-client` to 6.4.0
>
[
https://issues.apache.org/jira/browse/SPARK-42148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679433#comment-17679433
]
Apache Spark commented on SPARK-42148:
--
User 'dongjoon-hyun' has created a pull request for this
Dongjoon Hyun created SPARK-42148:
-
Summary: Upgrade `kubernetes-client` to 6.4.0
Key: SPARK-42148
URL: https://issues.apache.org/jira/browse/SPARK-42148
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-42147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42147:
-
Summary: Restore the signature of Utils#setStringField to
`setStringField(input: String, f: String =>
[
https://issues.apache.org/jira/browse/SPARK-42147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42147:
-
Summary: Restore Utils#setStringField (was: Revert change of SPARK-42146 )
> Restore
[
https://issues.apache.org/jira/browse/SPARK-42147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42147:
-
Description: Restore the signature of `f` when `f` is declared as `f:
String => MessageOrBuilder` and
[
https://issues.apache.org/jira/browse/SPARK-42147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42147:
-
Description:
Restore the signature of `f` when `f` is declared as `f: String =>
MessageOrBuilder` and
[
https://issues.apache.org/jira/browse/SPARK-42147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42147:
-
Description: Restore the signature of f to `f: String => MessageOrBuilder`
when `
[
https://issues.apache.org/jira/browse/SPARK-42147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42147:
-
Description: Restore the signature of f to `f: String => MessageOrBuilder`
when ` Utils#setStringField`
[
https://issues.apache.org/jira/browse/SPARK-42147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-42147:
-
Summary: Revert change of SPARK-42146 (was: Revert SPARK-42146 to make
maven build pass when sql
[
https://issues.apache.org/jira/browse/SPARK-42146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42146:
Assignee: (was: Apache Spark)
> Refactor `Utils#setStringField` to make maven build
[
https://issues.apache.org/jira/browse/SPARK-42146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679428#comment-17679428
]
Apache Spark commented on SPARK-42146:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-42146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42146:
Assignee: Apache Spark
> Refactor `Utils#setStringField` to make maven build pass when
[
https://issues.apache.org/jira/browse/SPARK-41470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41470:
Assignee: (was: Apache Spark)
> SPJ: Spark shouldn't assume InternalRow implements
[
https://issues.apache.org/jira/browse/SPARK-41470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679425#comment-17679425
]
Apache Spark commented on SPARK-41470:
--
User 'yabola' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-41470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41470:
Assignee: Apache Spark
> SPJ: Spark shouldn't assume InternalRow implements equals and
Yang Jie created SPARK-42147:
Summary: Revert SPARK-42146 to make maven build pass when sql
module use `Utils#setStringField`
Key: SPARK-42147
URL: https://issues.apache.org/jira/browse/SPARK-42147
Yang Jie created SPARK-42146:
Summary: Refactor `Utils#setStringField` to make maven build pass
when sql module use this method
Key: SPARK-42146
URL: https://issues.apache.org/jira/browse/SPARK-42146
83 matches
Mail list logo
