[jira] [Commented] (SPARK-36849) Migrate UseStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421205#comment-17421205 ] dohongdayi commented on SPARK-36849: [~huaxingao] May I help on this, since you have

[jira] [Assigned] (SPARK-36873) Add provided Guava dependency for network-yarn module

[ https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36873: Assignee: (was: Apache Spark) > Add provided Guava dependency for network-yarn module

[jira] [Assigned] (SPARK-36873) Add provided Guava dependency for network-yarn module

[ https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36873: Assignee: Apache Spark > Add provided Guava dependency for network-yarn module >

[jira] [Updated] (SPARK-36873) Add provided Guava dependency for network-yarn module

[ https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-36873: - Issue Type: Bug (was: Improvement) > Add provided Guava dependency for network-yarn module > --

[jira] [Commented] (SPARK-36873) Add provided Guava dependency for network-yarn module

[ https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421189#comment-17421189 ] Apache Spark commented on SPARK-36873: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-36873) Add provided Guava dependency for network-yarn module

[ https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421188#comment-17421188 ] Apache Spark commented on SPARK-36873: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-36873) Add provided Guava dependency for network-yarn module

[ https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36873: Assignee: Apache Spark > Add provided Guava dependency for network-yarn module >

[jira] [Updated] (SPARK-36873) Add provided Guava dependency for network-yarn module

[ https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-36873: - Description: In Spark 3.1 and earlier the network-yarn module implicitly relies on guava from hadoop-cl

[jira] [Updated] (SPARK-36873) Add provided Guava dependency for network-yarn module

[ https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-36873: - Description: In Spark 3.1 and earlier the network-yarn module implicitly relies on guava from hadoop-cl

[jira] [Created] (SPARK-36873) Add provided Guava dependency for network-yarn module

Chao Sun created SPARK-36873: Summary: Add provided Guava dependency for network-yarn module Key: SPARK-36873 URL: https://issues.apache.org/jira/browse/SPARK-36873 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421134#comment-17421134 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421133#comment-17421133 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request f

[jira] [Updated] (SPARK-36872) Decommissioning executors get killed before transferring their data because of the hardcoded timeout of 60 secs

[ https://issues.apache.org/jira/browse/SPARK-36872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Gupta updated SPARK-36872: -- Description: During the graceful decommissioning phase, executors need to transfer all of thei

[jira] [Created] (SPARK-36872) Decommissioning executors get killed before transferring their data because of the hardcoded timeout of 60 secs

Shekhar Gupta created SPARK-36872: - Summary: Decommissioning executors get killed before transferring their data because of the hardcoded timeout of 60 secs Key: SPARK-36872 URL: https://issues.apache.org/jira/bro

[jira] [Commented] (SPARK-36678) Migrate SHOW TABLES to use V2 command by default

[ https://issues.apache.org/jira/browse/SPARK-36678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421120#comment-17421120 ] Terry Kim commented on SPARK-36678: --- Got it, thanks. > Migrate SHOW TABLES to use V2

[jira] [Comment Edited] (SPARK-36586) Migrate all ParsedStatement to the new v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421106#comment-17421106 ] Terry Kim edited comment on SPARK-36586 at 9/28/21, 1:51 AM: -

[jira] [Commented] (SPARK-36586) Migrate all ParsedStatement to the new v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421106#comment-17421106 ] Terry Kim commented on SPARK-36586: --- [~cloud_fan] totally missed this ping. :) Looks l

[jira] [Comment Edited] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420568#comment-17420568 ] Yikun Jiang edited comment on SPARK-36058 at 9/28/21, 1:11 AM: ---

[jira] [Commented] (SPARK-36871) Migrate CreateViewStatement to v2 command

[ https://issues.apache.org/jira/browse/SPARK-36871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421095#comment-17421095 ] Huaxin Gao commented on SPARK-36871: I am working on this > Migrate CreateViewState

[jira] [Created] (SPARK-36871) Migrate CreateViewStatement to v2 command

Huaxin Gao created SPARK-36871: -- Summary: Migrate CreateViewStatement to v2 command Key: SPARK-36871 URL: https://issues.apache.org/jira/browse/SPARK-36871 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36870) Introduce INTERNAL_ERROR error class

[ https://issues.apache.org/jira/browse/SPARK-36870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421087#comment-17421087 ] Apache Spark commented on SPARK-36870: -- User 'karenfeng' has created a pull request

[jira] [Assigned] (SPARK-36870) Introduce INTERNAL_ERROR error class

[ https://issues.apache.org/jira/browse/SPARK-36870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36870: Assignee: Apache Spark > Introduce INTERNAL_ERROR error class > -

[jira] [Assigned] (SPARK-36870) Introduce INTERNAL_ERROR error class

[ https://issues.apache.org/jira/browse/SPARK-36870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36870: Assignee: (was: Apache Spark) > Introduce INTERNAL_ERROR error class > --

[jira] [Created] (SPARK-36870) Introduce INTERNAL_ERROR error class

Karen Feng created SPARK-36870: -- Summary: Introduce INTERNAL_ERROR error class Key: SPARK-36870 URL: https://issues.apache.org/jira/browse/SPARK-36870 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34826) Adaptive fetch of shuffle mergers for Push based shuffle

[ https://issues.apache.org/jira/browse/SPARK-34826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421077#comment-17421077 ] Apache Spark commented on SPARK-34826: -- User 'venkata91' has created a pull request

[jira] [Assigned] (SPARK-34826) Adaptive fetch of shuffle mergers for Push based shuffle

[ https://issues.apache.org/jira/browse/SPARK-34826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34826: Assignee: (was: Apache Spark) > Adaptive fetch of shuffle mergers for Push based shuf

[jira] [Assigned] (SPARK-34826) Adaptive fetch of shuffle mergers for Push based shuffle

[ https://issues.apache.org/jira/browse/SPARK-34826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34826: Assignee: Apache Spark > Adaptive fetch of shuffle mergers for Push based shuffle > -

[jira] [Commented] (SPARK-34826) Adaptive fetch of shuffle mergers for Push based shuffle

[ https://issues.apache.org/jira/browse/SPARK-34826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421075#comment-17421075 ] Apache Spark commented on SPARK-34826: -- User 'venkata91' has created a pull request

[jira] [Created] (SPARK-36869) Spark job fails due to java.io.InvalidClassException: scala.collection.mutable.WrappedArray$ofRef; local class incompatible

Hamid EL MAAZOUZ created SPARK-36869: Summary: Spark job fails due to java.io.InvalidClassException: scala.collection.mutable.WrappedArray$ofRef; local class incompatible Key: SPARK-36869 URL: https://issues.a

[jira] [Commented] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421067#comment-17421067 ] Apache Spark commented on SPARK-36868: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36868: Assignee: Apache Spark > Migrate CreateFunctionStatement to v2 command framework > --

[jira] [Commented] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421066#comment-17421066 ] Apache Spark commented on SPARK-36868: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36868: Assignee: (was: Apache Spark) > Migrate CreateFunctionStatement to v2 command framewo

[jira] [Created] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

Huaxin Gao created SPARK-36868: -- Summary: Migrate CreateFunctionStatement to v2 command framework Key: SPARK-36868 URL: https://issues.apache.org/jira/browse/SPARK-36868 Project: Spark Issue Typ

[jira] [Commented] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421017#comment-17421017 ] Apache Spark commented on SPARK-35672: -- User 'xkrogen' has created a pull request f

[jira] [Commented] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421016#comment-17421016 ] Erik Krogen commented on SPARK-35672: - Re-submitted at [PR #34120|https://github.com

[jira] [Commented] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421018#comment-17421018 ] Apache Spark commented on SPARK-35672: -- User 'xkrogen' has created a pull request f

[jira] [Created] (SPARK-36867) Misleading Error Message with Invalid Column and Group By

Alan Jackoway created SPARK-36867: - Summary: Misleading Error Message with Invalid Column and Group By Key: SPARK-36867 URL: https://issues.apache.org/jira/browse/SPARK-36867 Project: Spark I

[jira] [Commented] (SPARK-17722) YarnScheduler: Initial job has not accepted any resources

[ https://issues.apache.org/jira/browse/SPARK-17722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420999#comment-17420999 ] Davide Benedetto commented on SPARK-17722: -- Hi Partha I have your same issue. W

[jira] [Assigned] (SPARK-36863) Update dependency manifests for all released artifacts

[ https://issues.apache.org/jira/browse/SPARK-36863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36863: Assignee: Apache Spark > Update dependency manifests for all released artifacts > ---

[jira] [Assigned] (SPARK-36863) Update dependency manifests for all released artifacts

[ https://issues.apache.org/jira/browse/SPARK-36863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36863: Assignee: (was: Apache Spark) > Update dependency manifests for all released artifact

[jira] [Commented] (SPARK-36863) Update dependency manifests for all released artifacts

[ https://issues.apache.org/jira/browse/SPARK-36863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420994#comment-17420994 ] Apache Spark commented on SPARK-36863: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-36863) Update dependency manifests for all released artifacts

[ https://issues.apache.org/jira/browse/SPARK-36863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420995#comment-17420995 ] Apache Spark commented on SPARK-36863: -- User 'sunchao' has created a pull request f

[jira] [Resolved] (SPARK-36847) Explicitly specify error codes when ignoring type hint errors

[ https://issues.apache.org/jira/browse/SPARK-36847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36847. --- Fix Version/s: 3.3.0 Assignee: Takuya Ueshin Resolution: Fixed Issue resolve

[jira] [Created] (SPARK-36866) Pushdown filters with ANSI interval values to parquet

Max Gekk created SPARK-36866: Summary: Pushdown filters with ANSI interval values to parquet Key: SPARK-36866 URL: https://issues.apache.org/jira/browse/SPARK-36866 Project: Spark Issue Type: Sub

[jira] [Assigned] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36865: Assignee: Kousuke Saruta (was: Apache Spark) > Add PySpark API document of session_windo

[jira] [Commented] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420959#comment-17420959 ] Apache Spark commented on SPARK-36865: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36865: Assignee: Apache Spark (was: Kousuke Saruta) > Add PySpark API document of session_windo

[jira] [Assigned] (SPARK-36821) Create a test to extend ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-36821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-36821: --- Assignee: Yufei Gu > Create a test to extend ColumnarBatch > -

[jira] [Resolved] (SPARK-36821) Create a test to extend ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-36821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-36821. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34087 [https://github.com/a

[jira] [Updated] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Summary: Add PySpark API document of session_window (was: Add PySpark API document for sess

[jira] [Updated] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Description: There is no PySpark API document of session_window. The docstring of the functi

[jira] [Updated] (SPARK-36865) Add PySpark API document for session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Description: There is no PySpark API document for session_window. The docstring of the funct

[jira] [Updated] (SPARK-36865) Add PySpark API document for session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Summary: Add PySpark API document for session_window (was: The layout of PySpark API docume

[jira] [Created] (SPARK-36865) The layout of PySpark API document for session_window is broken

Kousuke Saruta created SPARK-36865: -- Summary: The layout of PySpark API document for session_window is broken Key: SPARK-36865 URL: https://issues.apache.org/jira/browse/SPARK-36865 Project: Spark

[jira] [Assigned] (SPARK-36864) guava version mismatch with hadoop-aws

[ https://issues.apache.org/jira/browse/SPARK-36864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36864: Assignee: (was: Apache Spark) > guava version mismatch with hadoop-aws >

[jira] [Assigned] (SPARK-36864) guava version mismatch with hadoop-aws

[ https://issues.apache.org/jira/browse/SPARK-36864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36864: Assignee: Apache Spark > guava version mismatch with hadoop-aws > ---

[jira] [Commented] (SPARK-36864) guava version mismatch with hadoop-aws

[ https://issues.apache.org/jira/browse/SPARK-36864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420935#comment-17420935 ] Apache Spark commented on SPARK-36864: -- User 'warrenzhu25' has created a pull reque

[jira] [Updated] (SPARK-36864) guava version mismatch with hadoop-aws

[ https://issues.apache.org/jira/browse/SPARK-36864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-36864: - Summary: guava version mismatch with hadoop-aws (was: guava version mismatch between hadoop-aws

[jira] [Assigned] (SPARK-36848) Migrate ShowCurrentNamespaceStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36848: --- Assignee: Huaxin Gao > Migrate ShowCurrentNamespaceStatement to v2 command framework >

[jira] [Resolved] (SPARK-36848) Migrate ShowCurrentNamespaceStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36848. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34104 [https://gith

[jira] [Created] (SPARK-36864) guava version mismatch between hadoop-aws and spark

Zhongwei Zhu created SPARK-36864: Summary: guava version mismatch between hadoop-aws and spark Key: SPARK-36864 URL: https://issues.apache.org/jira/browse/SPARK-36864 Project: Spark Issue Typ

[jira] [Created] (SPARK-36863) Update dependency manifests for all released artifacts

Chao Sun created SPARK-36863: Summary: Update dependency manifests for all released artifacts Key: SPARK-36863 URL: https://issues.apache.org/jira/browse/SPARK-36863 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420870#comment-17420870 ] Yongjun Zhang commented on SPARK-31646: --- Thanks [~mauzhang]. > Remove unused regi

[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420835#comment-17420835 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420834#comment-17420834 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request f

[jira] [Updated] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36861: Target Version/s: 3.3.0 Priority: Blocker (was: Major) > Partition columns are overly eagerly

[jira] [Comment Edited] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420568#comment-17420568 ] Yikun Jiang edited comment on SPARK-36058 at 9/27/21, 2:32 PM: ---

[jira] [Comment Edited] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420568#comment-17420568 ] Yikun Jiang edited comment on SPARK-36058 at 9/27/21, 2:31 PM: ---

[jira] [Assigned] (SPARK-36829) Refactor collectionOperation related Null check related code

[ https://issues.apache.org/jira/browse/SPARK-36829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36829: --- Assignee: angerszhu > Refactor collectionOperation related Null check related code > --

[jira] [Resolved] (SPARK-36829) Refactor collectionOperation related Null check related code

[ https://issues.apache.org/jira/browse/SPARK-36829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36829. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34077 [https://gith

[jira] [Commented] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420746#comment-17420746 ] Jungtaek Lim commented on SPARK-36862: -- I guess you'd have the generated code in th

[jira] [Commented] (SPARK-36817) Does Apache Spark 3 support GPU usage for Spark RDDs?

[ https://issues.apache.org/jira/browse/SPARK-36817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420737#comment-17420737 ] Thomas Graves commented on SPARK-36817: --- please refer to https://github.com/NVIDIA

[jira] [Commented] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420730#comment-17420730 ] Magdalena Pilawska commented on SPARK-36862: Hi [~kabhwan], I updated the d

[jira] [Updated] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Magdalena Pilawska updated SPARK-36862: --- Description: Hi, I am getting the following error running spark-submit command: ER

[jira] [Updated] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Magdalena Pilawska updated SPARK-36862: --- Description: Hi, I am getting the following error running spark-submit command: ER

[jira] [Commented] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420688#comment-17420688 ] Manu Zhang commented on SPARK-31646: {quote}So I will try to derive numBackLoggedCon

[jira] [Comment Edited] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420568#comment-17420568 ] Yikun Jiang edited comment on SPARK-36058 at 9/27/21, 11:22 AM: --

[jira] [Commented] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420671#comment-17420671 ] Jungtaek Lim commented on SPARK-36862: -- Could you please provide more information?

[jira] [Created] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

Magdalena Pilawska created SPARK-36862: -- Summary: ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' Key: SPARK-36862 URL: https://issues.apache.org/

[jira] [Commented] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420656#comment-17420656 ] Apache Spark commented on SPARK-36438: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36438: Assignee: Apache Spark > Support list-like Python objects for Series comparison > ---

[jira] [Commented] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420655#comment-17420655 ] Apache Spark commented on SPARK-36438: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36438: Assignee: (was: Apache Spark) > Support list-like Python objects for Series compariso

[jira] [Commented] (SPARK-36816) Introduce a config variable for the incrementalCollects row batch size

[ https://issues.apache.org/jira/browse/SPARK-36816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420578#comment-17420578 ] Ole commented on SPARK-36816: - I am running a Thrift Server {{/spark/sbin/start-thriftserver

[jira] [Commented] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420568#comment-17420568 ] Yikun Jiang commented on SPARK-36058: - After this, it makes the executor pod allocat

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420553#comment-17420553 ] Tanel Kiis commented on SPARK-36861: Sorry, indeed I ran the test on master. Nevermi

[jira] [Comment Edited] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420549#comment-17420549 ] Gengliang Wang edited comment on SPARK-36861 at 9/27/21, 8:06 AM:

[jira] [Updated] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36861: --- Affects Version/s: (was: 3.2.0) 3.3.0 > Partition columns are ove

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420549#comment-17420549 ] Gengliang Wang commented on SPARK-36861: Hmm, the PR https://github.com/apache/s

[jira] [Resolved] (SPARK-32712) Support writing Hive non-ORC/Parquet bucketed table

[ https://issues.apache.org/jira/browse/SPARK-32712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32712. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34103 [https://gith

[jira] [Assigned] (SPARK-32712) Support writing Hive non-ORC/Parquet bucketed table

[ https://issues.apache.org/jira/browse/SPARK-32712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32712: --- Assignee: Cheng Su > Support writing Hive non-ORC/Parquet bucketed table > ---

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420538#comment-17420538 ] Gengliang Wang commented on SPARK-36861: [~tanelk] This is a new behavior introd

[jira] [Assigned] (SPARK-36797) Union should resolve nested columns as top-level columns

[ https://issues.apache.org/jira/browse/SPARK-36797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36797: --- Assignee: L. C. Hsieh > Union should resolve nested columns as top-level columns >

[jira] [Resolved] (SPARK-36797) Union should resolve nested columns as top-level columns

[ https://issues.apache.org/jira/browse/SPARK-36797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36797. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34038 [https://gith

[jira] [Commented] (SPARK-36435) Implement MultIndex.equal_levels

[ https://issues.apache.org/jira/browse/SPARK-36435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420534#comment-17420534 ] Apache Spark commented on SPARK-36435: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-36435) Implement MultIndex.equal_levels

[ https://issues.apache.org/jira/browse/SPARK-36435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36435: Assignee: (was: Apache Spark) > Implement MultIndex.equal_levels > --

[jira] [Assigned] (SPARK-36435) Implement MultIndex.equal_levels

[ https://issues.apache.org/jira/browse/SPARK-36435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36435: Assignee: Apache Spark > Implement MultIndex.equal_levels > -

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420533#comment-17420533 ] Tanel Kiis commented on SPARK-36861: If this is expected behaviour, then I would exp

[jira] [Comment Edited] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420532#comment-17420532 ] Tanel Kiis edited comment on SPARK-36861 at 9/27/21, 7:45 AM:

  1   2   >