[jira] [Assigned] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

[ https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37481: Assignee: (was: Apache Spark) > Disappearance of skipped stages mislead the bug hunti

[jira] [Assigned] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

[ https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37481: Assignee: Apache Spark > Disappearance of skipped stages mislead the bug hunting > -

[jira] [Commented] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

[ https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450235#comment-17450235 ] Apache Spark commented on SPARK-37481: -- User 'yaooqinn' has created a pull request

[jira] [Updated] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

[ https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-37481: - Description: # ## With FetchFailedException and Map Stage Retries When rerunning spark-sql shell with

[jira] [Created] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

Kent Yao created SPARK-37481: Summary: Disappearance of skipped stages mislead the bug hunting Key: SPARK-37481 URL: https://issues.apache.org/jira/browse/SPARK-37481 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate

[ https://issues.apache.org/jira/browse/SPARK-37480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450233#comment-17450233 ] Apache Spark commented on SPARK-37480: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate

[ https://issues.apache.org/jira/browse/SPARK-37480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37480: Assignee: (was: Apache Spark) > Configurations in docs/running-on-kubernetes.md are n

[jira] [Assigned] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate

[ https://issues.apache.org/jira/browse/SPARK-37480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37480: Assignee: Apache Spark > Configurations in docs/running-on-kubernetes.md are not uptodate

[jira] [Created] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate

Yikun Jiang created SPARK-37480: --- Summary: Configurations in docs/running-on-kubernetes.md are not uptodate Key: SPARK-37480 URL: https://issues.apache.org/jira/browse/SPARK-37480 Project: Spark

[jira] [Commented] (SPARK-36525) DS V2 Index Support

[ https://issues.apache.org/jira/browse/SPARK-36525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450224#comment-17450224 ] Huaxin Gao commented on SPARK-36525: The major reason I work on index support is bec

[jira] [Commented] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450219#comment-17450219 ] Apache Spark commented on SPARK-36346: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-37392) Catalyst optimizer very time-consuming and memory-intensive with some "explode(array)"

[ https://issues.apache.org/jira/browse/SPARK-37392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois MARTIN updated SPARK-37392: Description: The problem occurs with the simple code below: {code:java} import session.imp

[jira] [Commented] (SPARK-37291) PySpark init SparkSession should copy conf to sharedState

[ https://issues.apache.org/jira/browse/SPARK-37291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450214#comment-17450214 ] Apache Spark commented on SPARK-37291: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-37291) PySpark init SparkSession should copy conf to sharedState

[ https://issues.apache.org/jira/browse/SPARK-37291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450213#comment-17450213 ] Apache Spark commented on SPARK-37291: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

[ https://issues.apache.org/jira/browse/SPARK-37055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450210#comment-17450210 ] dch nguyen commented on SPARK-37055: thanks! I will try to address them > Apply 'co

[jira] [Commented] (SPARK-36525) DS V2 Index Support

[ https://issues.apache.org/jira/browse/SPARK-36525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450207#comment-17450207 ] Yang Jie commented on SPARK-36525: -- Do we plan to make FileTable support the trait of S

[jira] [Assigned] (SPARK-37443) Provide a profiler for Python/Pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-37443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37443: Assignee: Takuya Ueshin > Provide a profiler for Python/Pandas UDFs > ---

[jira] [Resolved] (SPARK-37443) Provide a profiler for Python/Pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-37443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37443. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34685 [https://gi

[jira] [Commented] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

[ https://issues.apache.org/jira/browse/SPARK-37055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450197#comment-17450197 ] Hyukjin Kwon commented on SPARK-37055: -- equals is the same too: https://github.com

[jira] [Commented] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

[ https://issues.apache.org/jira/browse/SPARK-37055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450196#comment-17450196 ] Hyukjin Kwon commented on SPARK-37055: -- You can, for example, find some instances r

[jira] [Commented] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

[ https://issues.apache.org/jira/browse/SPARK-37055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450191#comment-17450191 ] dch nguyen commented on SPARK-37055: [~hyukjin.kwon] , no, I am not now. I did not f

[jira] [Commented] (SPARK-37479) Migrate DROP NAMESPACE to use V2 command by default

[ https://issues.apache.org/jira/browse/SPARK-37479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450189#comment-17450189 ] dch nguyen commented on SPARK-37479: working on this > Migrate DROP NAMESPACE to us

[jira] [Created] (SPARK-37479) Migrate DROP NAMESPACE to use V2 command by default

dch nguyen created SPARK-37479: -- Summary: Migrate DROP NAMESPACE to use V2 command by default Key: SPARK-37479 URL: https://issues.apache.org/jira/browse/SPARK-37479 Project: Spark Issue Type: S

[jira] [Commented] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests

[ https://issues.apache.org/jira/browse/SPARK-37478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450188#comment-17450188 ] dch nguyen commented on SPARK-37478: working on this > Unify v1 and v2 DROP NAMESPA

[jira] [Created] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests

dch nguyen created SPARK-37478: -- Summary: Unify v1 and v2 DROP NAMESPACE tests Key: SPARK-37478 URL: https://issues.apache.org/jira/browse/SPARK-37478 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37055) Apply 'compute.eager_check' across all the codebase

[ https://issues.apache.org/jira/browse/SPARK-37055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450187#comment-17450187 ] Hyukjin Kwon commented on SPARK-37055: -- [~dchvn], just checking - are you working o

[jira] [Commented] (SPARK-37153) Inline type hints for python/pyspark/profiler.py

[ https://issues.apache.org/jira/browse/SPARK-37153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450180#comment-17450180 ] Apache Spark commented on SPARK-37153: -- User 'dchvn' has created a pull request for

[jira] [Assigned] (SPARK-37153) Inline type hints for python/pyspark/profiler.py

[ https://issues.apache.org/jira/browse/SPARK-37153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37153: Assignee: Apache Spark > Inline type hints for python/pyspark/profiler.py > -

[jira] [Assigned] (SPARK-37153) Inline type hints for python/pyspark/profiler.py

[ https://issues.apache.org/jira/browse/SPARK-37153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37153: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/profiler.py > --

[jira] [Created] (SPARK-37477) Migrate SHOW CREATE TABLE to use V2 command by default

PengLei created SPARK-37477: --- Summary: Migrate SHOW CREATE TABLE to use V2 command by default Key: SPARK-37477 URL: https://issues.apache.org/jira/browse/SPARK-37477 Project: Spark Issue Type: Sub-

[jira] [Resolved] (SPARK-37461) yarn-client mode client's appid value is null

[ https://issues.apache.org/jira/browse/SPARK-37461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37461. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34710 [https://gi

[jira] [Updated] (SPARK-37461) yarn-client mode client's appid value is null

[ https://issues.apache.org/jira/browse/SPARK-37461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37461: - Priority: Minor (was: Major) > yarn-client mode client's appid value is null >

[jira] [Assigned] (SPARK-37461) yarn-client mode client's appid value is null

[ https://issues.apache.org/jira/browse/SPARK-37461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37461: Assignee: angerszhu > yarn-client mode client's appid value is null > ---

[jira] [Commented] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O"

[ https://issues.apache.org/jira/browse/SPARK-37213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450027#comment-17450027 ] liu zhuang commented on SPARK-37213: OK，thank you. > In the latest version release