[jira] [Resolved] (SPARK-36536) Split the JSON/CSV option of datetime format to in read and in write

[ https://issues.apache.org/jira/browse/SPARK-36536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36536. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33769 [https://github.com

[jira] [Resolved] (SPARK-36512) Fix UISeleniumSuite in sql/hive-thriftserver

[ https://issues.apache.org/jira/browse/SPARK-36512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36512. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33741 [https:

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401484#comment-17401484 ] Apache Spark commented on SPARK-34309: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401483#comment-17401483 ] Apache Spark commented on SPARK-34309: -- User 'LuciferYang' has created a pull reque

[jira] [Resolved] (SPARK-35991) Add PlanStability suite for TPCH

[ https://issues.apache.org/jira/browse/SPARK-35991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35991. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33736 [https://gith

[jira] [Assigned] (SPARK-35991) Add PlanStability suite for TPCH

[ https://issues.apache.org/jira/browse/SPARK-35991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35991: --- Assignee: angerszhu > Add PlanStability suite for TPCH > >

[jira] [Resolved] (SPARK-36371) Support raw string literal

[ https://issues.apache.org/jira/browse/SPARK-36371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36371. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33599 [https://gith

[jira] [Commented] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401441#comment-17401441 ] Apache Spark commented on SPARK-35011: -- User 'sumeetgajjar' has created a pull requ

[jira] [Commented] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401440#comment-17401440 ] Apache Spark commented on SPARK-35011: -- User 'sumeetgajjar' has created a pull requ

[jira] [Assigned] (SPARK-36147) [SQL] - log level should be warning if files not found in BasicWriteStatsTracker

[ https://issues.apache.org/jira/browse/SPARK-36147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36147: Assignee: t oo > [SQL] - log level should be warning if files not found in > BasicWriteS

[jira] [Resolved] (SPARK-36147) [SQL] - log level should be warning if files not found in BasicWriteStatsTracker

[ https://issues.apache.org/jira/browse/SPARK-36147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36147. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 2 [https://gi

[jira] [Updated] (SPARK-34949) Executor.reportHeartBeat reregisters blockManager even when Executor is shutting down

[ https://issues.apache.org/jira/browse/SPARK-34949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34949: -- Fix Version/s: 3.0.4 > Executor.reportHeartBeat reregisters blockManager even when Executor is

[jira] [Updated] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35011: -- Fix Version/s: 3.1.3 > Avoid Block Manager registerations when StopExecutor msg is in-flight.

[jira] [Commented] (SPARK-36488) "Invalid usage of '*' in expression" error due to the feature of 'quotedRegexColumnNames' in some scenarios.

[ https://issues.apache.org/jira/browse/SPARK-36488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401401#comment-17401401 ] Pablo Langa Blanco commented on SPARK-36488: Hi [~merrily01] , I think thes

[jira] [Created] (SPARK-36544) Special strings for dates are no longer automatically converted without the "date" keyword

Lauri Koobas created SPARK-36544: Summary: Special strings for dates are no longer automatically converted without the "date" keyword Key: SPARK-36544 URL: https://issues.apache.org/jira/browse/SPARK-36544

[jira] [Resolved] (SPARK-36368) Fix CategoricalOps.astype to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36368. --- Fix Version/s: 3.3.0 Assignee: Haejoon Lee Resolution: Fixed Issue resolved

[jira] [Comment Edited] (SPARK-30873) Handling Node Decommissioning for Yarn cluster manger in Spark

[ https://issues.apache.org/jira/browse/SPARK-30873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401282#comment-17401282 ] Jason Xu edited comment on SPARK-30873 at 8/18/21, 6:01 PM:

[jira] [Commented] (SPARK-30873) Handling Node Decommissioning for Yarn cluster manger in Spark

[ https://issues.apache.org/jira/browse/SPARK-30873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401282#comment-17401282 ] Jason Xu commented on SPARK-30873: -- Hi Saurabh, I found your work is useful in dealing

[jira] [Commented] (SPARK-33687) ANALYZE command support analyze all tables in a specific database

[ https://issues.apache.org/jira/browse/SPARK-33687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401201#comment-17401201 ] Apache Spark commented on SPARK-33687: -- User 'cloud-fan' has created a pull request

[jira] [Resolved] (SPARK-36407) Avoid potential integer multiplications overflow risk

[ https://issues.apache.org/jira/browse/SPARK-36407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36407. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33629 [https://gi

[jira] [Assigned] (SPARK-36407) Avoid potential integer multiplications overflow risk

[ https://issues.apache.org/jira/browse/SPARK-36407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36407: Assignee: Yang Jie > Avoid potential integer multiplications overflow risk >

[jira] [Resolved] (SPARK-36532) Deadlock in CoarseGrainedExecutorBackend.onDisconnected

[ https://issues.apache.org/jira/browse/SPARK-36532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36532. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33759 [https://gith

[jira] [Assigned] (SPARK-36532) Deadlock in CoarseGrainedExecutorBackend.onDisconnected

[ https://issues.apache.org/jira/browse/SPARK-36532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36532: --- Assignee: wuyi > Deadlock in CoarseGrainedExecutorBackend.onDisconnected >

[jira] [Commented] (SPARK-34095) Spark 3.0.1 is giving WARN while running job

[ https://issues.apache.org/jira/browse/SPARK-34095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401067#comment-17401067 ] Berg Lloyd-Haig commented on SPARK-34095: -   [~smurarka] I am getting a similar

[jira] [Resolved] (SPARK-36451) Ivy skips looking for source and doc pom

[ https://issues.apache.org/jira/browse/SPARK-36451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36451. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33678 [https://gi

[jira] [Assigned] (SPARK-36451) Ivy skips looking for source and doc pom

[ https://issues.apache.org/jira/browse/SPARK-36451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36451: Assignee: dzcxzl > Ivy skips looking for source and doc pom > ---

[jira] [Created] (SPARK-36543) Decommission logs too frequent when waiting migration to finish

wuyi created SPARK-36543: Summary: Decommission logs too frequent when waiting migration to finish Key: SPARK-36543 URL: https://issues.apache.org/jira/browse/SPARK-36543 Project: Spark Issue Type:

[jira] [Created] (SPARK-36542) Unable to create executor due to unable to connect to external shuffle server

Likhitha created SPARK-36542: Summary: Unable to create executor due to unable to connect to external shuffle server Key: SPARK-36542 URL: https://issues.apache.org/jira/browse/SPARK-36542 Project: Spark

[jira] [Commented] (SPARK-36541) Images used in pyspark documentation still use Koalas

[ https://issues.apache.org/jira/browse/SPARK-36541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400960#comment-17400960 ] Leona Yoda commented on SPARK-36541: The original images and keynote files are linke

[jira] [Updated] (SPARK-36541) Images used in pyspark documentation still use Koalas

[ https://issues.apache.org/jira/browse/SPARK-36541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leona Yoda updated SPARK-36541: --- Attachment: images_replaced.key > Images used in pyspark documentation still use Koalas > --

[jira] [Created] (SPARK-36541) Images used in pyspark documentation still use Koalas

Leona Yoda created SPARK-36541: -- Summary: Images used in pyspark documentation still use Koalas Key: SPARK-36541 URL: https://issues.apache.org/jira/browse/SPARK-36541 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36540) AM should not just finish with Success when dissconnected

[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400897#comment-17400897 ] Apache Spark commented on SPARK-36540: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36540) AM should not just finish with Success when dissconnected

[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36540: Assignee: (was: Apache Spark) > AM should not just finish with Success when dissconne

[jira] [Assigned] (SPARK-36540) AM should not just finish with Success when dissconnected

[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36540: Assignee: Apache Spark > AM should not just finish with Success when dissconnected >

[jira] [Commented] (SPARK-36540) AM should not just finish with Success when dissconnected

[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400899#comment-17400899 ] Apache Spark commented on SPARK-36540: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400895#comment-17400895 ] Apache Spark commented on SPARK-36302: -- User 'dgd-contributor' has created a pull r

[jira] [Commented] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400894#comment-17400894 ] Apache Spark commented on SPARK-36302: -- User 'dgd-contributor' has created a pull r

[jira] [Assigned] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36302: Assignee: (was: Apache Spark) > Refactor thirteenth set of 20 query execution errors

[jira] [Assigned] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36302: Assignee: Apache Spark > Refactor thirteenth set of 20 query execution errors to use erro

[jira] [Updated] (SPARK-36540) AM should not just finish with Success when dissconnected

[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36540: -- Description: We meet a case AM lose connection {code} 21/08/18 02:14:15 ERROR TransportRequestHandler:

[jira] [Updated] (SPARK-36540) AM should not just finish with Success when dissconnected

[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36540: -- Description: We meet a case AM lose connection {code} 21/08/18 02:14:15 ERROR TransportRequestHandler:

[jira] [Created] (SPARK-36540) AM should not just finish with Success when dissconnected

angerszhu created SPARK-36540: - Summary: AM should not just finish with Success when dissconnected Key: SPARK-36540 URL: https://issues.apache.org/jira/browse/SPARK-36540 Project: Spark Issue Typ