[
https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486268#comment-17486268
]
Sujit Biswas edited comment on SPARK-38061 at 2/3/22, 7:49 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-37936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486269#comment-17486269
]
Apache Spark commented on SPARK-37936:
--
User 'senthh' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486268#comment-17486268
]
Sujit Biswas commented on SPARK-38061:
--
also if some of the issues are resolved, ho
[
https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486264#comment-17486264
]
Sujit Biswas commented on SPARK-38061:
--
not at all helpful, please refer to valid r
[
https://issues.apache.org/jira/browse/SPARK-38058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486263#comment-17486263
]
john commented on SPARK-38058:
--
since i am working in production env i cannot disclose any
[
https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486254#comment-17486254
]
Hyukjin Kwon commented on SPARK-38061:
--
No, the security report here simply mention
[
https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486246#comment-17486246
]
Sujit Biswas commented on SPARK-38061:
--
info is there in the attachment, you can do
[
https://issues.apache.org/jira/browse/SPARK-38094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38094:
Assignee: (was: Apache Spark)
> Parquet: enable matching schema columns by field id
>
[
https://issues.apache.org/jira/browse/SPARK-38094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38094:
Assignee: Apache Spark
> Parquet: enable matching schema columns by field id
> --
[
https://issues.apache.org/jira/browse/SPARK-38094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486237#comment-17486237
]
Apache Spark commented on SPARK-38094:
--
User 'jackierwzhang' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486236#comment-17486236
]
Hyukjin Kwon commented on SPARK-38061:
--
[~sujitbiswas] Let's separate a ticket for
[
https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486231#comment-17486231
]
Sujit Biswas commented on SPARK-38061:
--
[~hyukjin.kwon]
note jackson-databind sol
[
https://issues.apache.org/jira/browse/SPARK-38073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486219#comment-17486219
]
Hyukjin Kwon commented on SPARK-38073:
--
I think we should fix this ..
> NameError
[
https://issues.apache.org/jira/browse/SPARK-38074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-38074.
--
Resolution: Invalid
> RuntimeError: Java gateway process exited before sending its port number
[
https://issues.apache.org/jira/browse/SPARK-38074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486216#comment-17486216
]
Hyukjin Kwon commented on SPARK-38074:
--
It's very likely your network configuration
[
https://issues.apache.org/jira/browse/SPARK-38074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-38074:
-
Priority: Major (was: Blocker)
> RuntimeError: Java gateway process exited before sending its p
[
https://issues.apache.org/jira/browse/SPARK-38087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486215#comment-17486215
]
Deepa Vasanthkumar commented on SPARK-38087:
[~dongjoon] Thank you, not sur
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38095.
---
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35384
[https://
[
https://issues.apache.org/jira/browse/SPARK-38082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486203#comment-17486203
]
Hyukjin Kwon commented on SPARK-38082:
--
Yeah .. we should probably upgrade the mini
[
https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-38061.
--
Resolution: Duplicate
> security scan issue jackson-databinding HDFS dependency library
>
[
https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486202#comment-17486202
]
Hyukjin Kwon commented on SPARK-38061:
--
That's already upgraded at SPARK-35550
> s
[
https://issues.apache.org/jira/browse/SPARK-38058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486201#comment-17486201
]
Hyukjin Kwon commented on SPARK-38058:
--
spark.speculation has been disabled many ye
[
https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486200#comment-17486200
]
Apache Spark commented on SPARK-38066:
--
User 'Stove-hust' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38066:
Assignee: (was: Apache Spark)
> evaluateEquality should ignore attribute without min/
[
https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38066:
Assignee: Apache Spark
> evaluateEquality should ignore attribute without min/max ColumnS
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486181#comment-17486181
]
Apache Spark commented on SPARK-38095:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-38095:
-
Assignee: Dongjoon Hyun
> HistoryServerDiskManager.appStorePath should use backend-base
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-38095:
-
Assignee: Dongjoon Hyun (was: Apache Spark)
> HistoryServerDiskManager.appStorePath sh
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38095:
Assignee: (was: Dongjoon Hyun)
> HistoryServerDiskManager.appStorePath should use bac
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486180#comment-17486180
]
Apache Spark commented on SPARK-38095:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38095:
Assignee: Apache Spark
> HistoryServerDiskManager.appStorePath should use backend-based e
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38095:
--
Parent: SPARK-35781
Issue Type: Sub-task (was: Bug)
> HistoryServerDiskManager.appSto
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38095:
--
Summary: HistoryServerDiskManager.appStorePath should use backend-based
extensions (was: Hist
[
https://issues.apache.org/jira/browse/SPARK-38095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38095:
--
Summary: HistoryServerDiskManager.appStorePath should use backend
extensions (was: HistorySer
Dongjoon Hyun created SPARK-38095:
-
Summary: HistoryServerDiskManager should use backend extensions
for `apps` directory
Key: SPARK-38095
URL: https://issues.apache.org/jira/browse/SPARK-38095
Project
[
https://issues.apache.org/jira/browse/SPARK-37958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-37958.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35377
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-37958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-37958:
Assignee: Leona Yoda
> Pyspark SparkContext.AddFile() does not respect spark.files.overwr
Jackie Zhang created SPARK-38094:
Summary: Parquet: enable matching schema columns by field id
Key: SPARK-38094
URL: https://issues.apache.org/jira/browse/SPARK-38094
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-38087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38087:
--
Fix Version/s: (was: 3.3)
> select doesnt validate if the column already exists
>
[
https://issues.apache.org/jira/browse/SPARK-38087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486167#comment-17486167
]
Dongjoon Hyun commented on SPARK-38087:
---
I removed the fixed version field, [~deep
[
https://issues.apache.org/jira/browse/SPARK-30062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30062:
--
Fix Version/s: 3.3.0
(was: 3.3)
> bug with DB2Driver using mode("overwr
[
https://issues.apache.org/jira/browse/SPARK-38089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38089:
--
Summary: Show the root cause exception in TestUtils.assertExceptionMsg
(was: Improve assertio
[
https://issues.apache.org/jira/browse/SPARK-38089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38089.
---
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35383
[https://
[
https://issues.apache.org/jira/browse/SPARK-38089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38089:
--
Affects Version/s: 3.3.0
(was: 3.2.1)
> Show the root cause excepti
[
https://issues.apache.org/jira/browse/SPARK-38089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-38089:
-
Assignee: Erik Krogen
> Improve assertion failure message in TestUtils.assertExceptionM
[
https://issues.apache.org/jira/browse/SPARK-37996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486139#comment-17486139
]
Khalid Mammadov commented on SPARK-37996:
-
Raised PR: https://github.com/apache/
[
https://issues.apache.org/jira/browse/SPARK-37771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486107#comment-17486107
]
Ivan Sadikov commented on SPARK-37771:
--
I could not manage to work around the issue
[
https://issues.apache.org/jira/browse/SPARK-38091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486092#comment-17486092
]
Erik Krogen commented on SPARK-38091:
-
[~Zhen-hao] for formatting you need to use th
Venkata krishnan Sowrirajan created SPARK-38093:
---
Summary: Set shuffleMergeAllowed to false for a determinate stage
after the stage is finalized
Key: SPARK-38093
URL: https://issues.apache.org/jira/b
Venkata krishnan Sowrirajan created SPARK-38092:
---
Summary: Check if shuffleMergeId is the same as the current
stage's shuffleMergeId before registering MergeStatus
Key: SPARK-38092
URL: https://issue
[
https://issues.apache.org/jira/browse/SPARK-38047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alex Holmes updated SPARK-38047:
Description:
Currently executor rolling will always kill one executor every
{{{}spark.kubernetes.
[
https://issues.apache.org/jira/browse/SPARK-38091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486041#comment-17486041
]
Apache Spark commented on SPARK-38091:
--
User 'Zhen-hao' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38091:
Assignee: Apache Spark
> AvroSerializer can cause java.lang.ClassCastException at run tim
[
https://issues.apache.org/jira/browse/SPARK-38091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38091:
Assignee: (was: Apache Spark)
> AvroSerializer can cause java.lang.ClassCastException
[
https://issues.apache.org/jira/browse/SPARK-38091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486036#comment-17486036
]
Zhenhao Li commented on SPARK-38091:
Can someone tell me how to let Jira render mark
Zhenhao Li created SPARK-38091:
--
Summary: AvroSerializer can cause java.lang.ClassCastException at
run time
Key: SPARK-38091
URL: https://issues.apache.org/jira/browse/SPARK-38091
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38089:
Assignee: (was: Apache Spark)
> Improve assertion failure message in TestUtils.assert
[
https://issues.apache.org/jira/browse/SPARK-38089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486025#comment-17486025
]
Apache Spark commented on SPARK-38089:
--
User 'xkrogen' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-38089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486027#comment-17486027
]
Apache Spark commented on SPARK-38089:
--
User 'xkrogen' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-38089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38089:
Assignee: Apache Spark
> Improve assertion failure message in TestUtils.assertExceptionMs
Holden Karau created SPARK-38090:
Summary: Make links for stderr/stdout on Spark on Kube configurable
Key: SPARK-38090
URL: https://issues.apache.org/jira/browse/SPARK-38090
Project: Spark
Is
Erik Krogen created SPARK-38089:
---
Summary: Improve assertion failure message in
TestUtils.assertExceptionMsg
Key: SPARK-38089
URL: https://issues.apache.org/jira/browse/SPARK-38089
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-37145.
---
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35345
[https://
[
https://issues.apache.org/jira/browse/SPARK-37145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-37145:
-
Assignee: Yikun Jiang
> Improvement for extending pod feature steps with KubernetesConf
[
https://issues.apache.org/jira/browse/SPARK-37145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37145:
--
Summary: Add KubernetesCustom[Driver/Executor]FeatureConfigStep developer
API (was: Improveme
[
https://issues.apache.org/jira/browse/SPARK-37771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17485973#comment-17485973
]
Steve Loughran commented on SPARK-37771:
[~ivan.sadikov] -any update here?
> Ra
[
https://issues.apache.org/jira/browse/SPARK-28090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17485917#comment-17485917
]
Apache Spark commented on SPARK-28090:
--
User 'peter-toth' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michał Wieleba updated SPARK-38088:
---
Attachment: (was: image-2022-02-02-10-08-51-144.png)
> Kryo DataWritingSparkTaskResult r
[
https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michał Wieleba updated SPARK-38088:
---
Description:
Spark 3.1.2, Scala 2.12
I'm registering classes with _sparkConf.registerKryoCl
[
https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michał Wieleba updated SPARK-38088:
---
Attachment: image-2022-02-02-10-09-14-858.png
> Kryo DataWritingSparkTaskResult registration
[
https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michał Wieleba updated SPARK-38088:
---
Attachment: image-2022-02-02-10-08-51-144.png
> Kryo DataWritingSparkTaskResult registration
[
https://issues.apache.org/jira/browse/SPARK-38088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michał Wieleba updated SPARK-38088:
---
Description:
Spark 3.1.2, Scala 2.12
I'm registering classes with _sparkConf.registerKryoCl
Michał Wieleba created SPARK-38088:
--
Summary: Kryo DataWritingSparkTaskResult registration error
Key: SPARK-38088
URL: https://issues.apache.org/jira/browse/SPARK-38088
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-37908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-37908.
---
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35209
[https://
[
https://issues.apache.org/jira/browse/SPARK-37908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-37908:
-
Assignee: Yikun Jiang
> Refactoring on pod label test in BasicFeatureStepSuite
> --
75 matches
Mail list logo