[jira] [Resolved] (SPARK-36512) Fix UISeleniumSuite in sql/hive-thriftserver

2021-08-18 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36512. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33741

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401484#comment-17401484 ] Apache Spark commented on SPARK-34309: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401483#comment-17401483 ] Apache Spark commented on SPARK-34309: -- User 'LuciferYang' has created a pull request for this

[jira] [Resolved] (SPARK-35991) Add PlanStability suite for TPCH

2021-08-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35991. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33736

[jira] [Assigned] (SPARK-35991) Add PlanStability suite for TPCH

2021-08-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35991: --- Assignee: angerszhu > Add PlanStability suite for TPCH >

[jira] [Resolved] (SPARK-36371) Support raw string literal

2021-08-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36371. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33599

[jira] [Commented] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401441#comment-17401441 ] Apache Spark commented on SPARK-35011: -- User 'sumeetgajjar' has created a pull request for this

[jira] [Commented] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401440#comment-17401440 ] Apache Spark commented on SPARK-35011: -- User 'sumeetgajjar' has created a pull request for this

[jira] [Assigned] (SPARK-36147) [SQL] - log level should be warning if files not found in BasicWriteStatsTracker

2021-08-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36147: Assignee: t oo > [SQL] - log level should be warning if files not found in >

[jira] [Resolved] (SPARK-36147) [SQL] - log level should be warning if files not found in BasicWriteStatsTracker

2021-08-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36147. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Updated] (SPARK-34949) Executor.reportHeartBeat reregisters blockManager even when Executor is shutting down

2021-08-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34949: -- Fix Version/s: 3.0.4 > Executor.reportHeartBeat reregisters blockManager even when Executor

[jira] [Updated] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

2021-08-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35011: -- Fix Version/s: 3.1.3 > Avoid Block Manager registerations when StopExecutor msg is in-flight.

[jira] [Commented] (SPARK-36488) "Invalid usage of '*' in expression" error due to the feature of 'quotedRegexColumnNames' in some scenarios.

2021-08-18 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401401#comment-17401401 ] Pablo Langa Blanco commented on SPARK-36488: Hi [~merrily01] , I think these are not bugs.

[jira] [Created] (SPARK-36544) Special strings for dates are no longer automatically converted without the "date" keyword

2021-08-18 Thread Lauri Koobas (Jira)
Lauri Koobas created SPARK-36544: Summary: Special strings for dates are no longer automatically converted without the "date" keyword Key: SPARK-36544 URL: https://issues.apache.org/jira/browse/SPARK-36544

[jira] [Resolved] (SPARK-36368) Fix CategoricalOps.astype to follow pandas 1.3

2021-08-18 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36368. --- Fix Version/s: 3.3.0 Assignee: Haejoon Lee Resolution: Fixed Issue resolved

[jira] [Comment Edited] (SPARK-30873) Handling Node Decommissioning for Yarn cluster manger in Spark

2021-08-18 Thread Jason Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401282#comment-17401282 ] Jason Xu edited comment on SPARK-30873 at 8/18/21, 6:01 PM: Hi

[jira] [Commented] (SPARK-30873) Handling Node Decommissioning for Yarn cluster manger in Spark

2021-08-18 Thread Jason Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401282#comment-17401282 ] Jason Xu commented on SPARK-30873: -- Hi Saurabh, I found your work is useful in dealing with Yarn node

[jira] [Commented] (SPARK-33687) ANALYZE command support analyze all tables in a specific database

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401201#comment-17401201 ] Apache Spark commented on SPARK-33687: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-36407) Avoid potential integer multiplications overflow risk

2021-08-18 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36407. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33629

[jira] [Assigned] (SPARK-36407) Avoid potential integer multiplications overflow risk

2021-08-18 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36407: Assignee: Yang Jie > Avoid potential integer multiplications overflow risk >

[jira] [Resolved] (SPARK-36532) Deadlock in CoarseGrainedExecutorBackend.onDisconnected

2021-08-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36532. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33759

[jira] [Assigned] (SPARK-36532) Deadlock in CoarseGrainedExecutorBackend.onDisconnected

2021-08-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36532: --- Assignee: wuyi > Deadlock in CoarseGrainedExecutorBackend.onDisconnected >

[jira] [Commented] (SPARK-34095) Spark 3.0.1 is giving WARN while running job

2021-08-18 Thread Berg Lloyd-Haig (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401067#comment-17401067 ] Berg Lloyd-Haig commented on SPARK-34095: -   [~smurarka] I am getting a similar warning to

[jira] [Resolved] (SPARK-36451) Ivy skips looking for source and doc pom

2021-08-18 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36451. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33678

[jira] [Assigned] (SPARK-36451) Ivy skips looking for source and doc pom

2021-08-18 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36451: Assignee: dzcxzl > Ivy skips looking for source and doc pom >

[jira] [Created] (SPARK-36543) Decommission logs too frequent when waiting migration to finish

2021-08-18 Thread wuyi (Jira)
wuyi created SPARK-36543: Summary: Decommission logs too frequent when waiting migration to finish Key: SPARK-36543 URL: https://issues.apache.org/jira/browse/SPARK-36543 Project: Spark Issue Type:

[jira] [Created] (SPARK-36542) Unable to create executor due to unable to connect to external shuffle server

2021-08-18 Thread Likhitha (Jira)
Likhitha created SPARK-36542: Summary: Unable to create executor due to unable to connect to external shuffle server Key: SPARK-36542 URL: https://issues.apache.org/jira/browse/SPARK-36542 Project: Spark

[jira] [Commented] (SPARK-36541) Images used in pyspark documentation still use Koalas

2021-08-18 Thread Leona Yoda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400960#comment-17400960 ] Leona Yoda commented on SPARK-36541: The original images and keynote files are linked on this issue

[jira] [Updated] (SPARK-36541) Images used in pyspark documentation still use Koalas

2021-08-18 Thread Leona Yoda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leona Yoda updated SPARK-36541: --- Attachment: images_replaced.key > Images used in pyspark documentation still use Koalas >

[jira] [Created] (SPARK-36541) Images used in pyspark documentation still use Koalas

2021-08-18 Thread Leona Yoda (Jira)
Leona Yoda created SPARK-36541: -- Summary: Images used in pyspark documentation still use Koalas Key: SPARK-36541 URL: https://issues.apache.org/jira/browse/SPARK-36541 Project: Spark Issue

[jira] [Commented] (SPARK-36540) AM should not just finish with Success when dissconnected

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400897#comment-17400897 ] Apache Spark commented on SPARK-36540: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36540) AM should not just finish with Success when dissconnected

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36540: Assignee: (was: Apache Spark) > AM should not just finish with Success when

[jira] [Assigned] (SPARK-36540) AM should not just finish with Success when dissconnected

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36540: Assignee: Apache Spark > AM should not just finish with Success when dissconnected >

[jira] [Commented] (SPARK-36540) AM should not just finish with Success when dissconnected

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400899#comment-17400899 ] Apache Spark commented on SPARK-36540: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400895#comment-17400895 ] Apache Spark commented on SPARK-36302: -- User 'dgd-contributor' has created a pull request for this

[jira] [Commented] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400894#comment-17400894 ] Apache Spark commented on SPARK-36302: -- User 'dgd-contributor' has created a pull request for this

[jira] [Assigned] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36302: Assignee: (was: Apache Spark) > Refactor thirteenth set of 20 query execution errors

[jira] [Assigned] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36302: Assignee: Apache Spark > Refactor thirteenth set of 20 query execution errors to use

[jira] [Updated] (SPARK-36540) AM should not just finish with Success when dissconnected

2021-08-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36540: -- Description: We meet a case AM lose connection {code} 21/08/18 02:14:15 ERROR

[jira] [Updated] (SPARK-36540) AM should not just finish with Success when dissconnected

2021-08-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36540: -- Description: We meet a case AM lose connection {code} 21/08/18 02:14:15 ERROR

[jira] [Created] (SPARK-36540) AM should not just finish with Success when dissconnected

2021-08-18 Thread angerszhu (Jira)
angerszhu created SPARK-36540: - Summary: AM should not just finish with Success when dissconnected Key: SPARK-36540 URL: https://issues.apache.org/jira/browse/SPARK-36540 Project: Spark Issue

[jira] [Commented] (SPARK-36539) trimNonTopLevelAlias should not change StructType inner alias

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400818#comment-17400818 ] Apache Spark commented on SPARK-36539: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36539) trimNonTopLevelAlias should not change StructType inner alias

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36539: Assignee: (was: Apache Spark) > trimNonTopLevelAlias should not change StructType

[jira] [Assigned] (SPARK-36539) trimNonTopLevelAlias should not change StructType inner alias

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36539: Assignee: Apache Spark > trimNonTopLevelAlias should not change StructType inner alias >

[jira] [Commented] (SPARK-36539) trimNonTopLevelAlias should not change StructType inner alias

2021-08-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400816#comment-17400816 ] Apache Spark commented on SPARK-36539: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-36539) trimNonTopLevelAlias should not change StructType inner alias

2021-08-18 Thread angerszhu (Jira)
angerszhu created SPARK-36539: - Summary: trimNonTopLevelAlias should not change StructType inner alias Key: SPARK-36539 URL: https://issues.apache.org/jira/browse/SPARK-36539 Project: Spark

[jira] [Commented] (SPARK-36465) Dynamic gap duration in session window

2021-08-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400805#comment-17400805 ] L. C. Hsieh commented on SPARK-36465: - Thanks [~Gengliang.Wang]! > Dynamic gap duration in session