[jira] [Created] (SPARK-45612) Allow cached RDDs to be migrated to fallback storage during decommission

2023-10-19 Thread Frank Yin (Jira)
Frank Yin created SPARK-45612: - Summary: Allow cached RDDs to be migrated to fallback storage during decommission Key: SPARK-45612 URL: https://issues.apache.org/jira/browse/SPARK-45612 Project: Spark

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some ra

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some ra

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some ra

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some ra

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some ra

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some ra

[jira] [Created] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
Frank Yin created SPARK-45579: - Summary: Executor hangs indefinitely due to decommissioner errors Key: SPARK-45579 URL: https://issues.apache.org/jira/browse/SPARK-45579 Project: Spark Issue Type

[jira] [Updated] (SPARK-44547) BlockManagerDecommissioner throws exceptions when migrating RDD cached blocks to fallback storage

2023-07-25 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-44547: -- Description: Looks like the RDD cache doesn't support fallback storage and we should stop the migrati

[jira] [Updated] (SPARK-44547) BlockManagerDecommissioner throws exceptions when migrating RDD cached blocks to fallback storage

2023-07-25 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-44547: -- Attachment: spark-error.log > BlockManagerDecommissioner throws exceptions when migrating RDD cached b

[jira] [Updated] (SPARK-44547) BlockManagerDecommissioner throws exceptions when migrating RDD cached blocks to fallback storage

2023-07-25 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-44547: -- Description: Looks like the RDD cache doesn't support fallback storage and we should stop the migrati

[jira] [Created] (SPARK-44547) BlockManagerDecommissioner throws exceptions when migrating RDD cached blocks to fallback storage

2023-07-25 Thread Frank Yin (Jira)
Frank Yin created SPARK-44547: - Summary: BlockManagerDecommissioner throws exceptions when migrating RDD cached blocks to fallback storage Key: SPARK-44547 URL: https://issues.apache.org/jira/browse/SPARK-44547

[jira] [Commented] (SPARK-39200) Stream is corrupted Exception while fetching the blocks from fallback storage system

2022-09-21 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17608008#comment-17608008 ] Frank Yin commented on SPARK-39200: --- We've seen this exception as well. Is there a pat

[jira] [Updated] (SPARK-32059) Nested Schema Pruning not Working in Window Functions

2020-06-22 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-32059: -- Description: Using tables and data structures in `SchemaPruningSuite.scala`   {code:java} // code pla

[jira] [Created] (SPARK-32059) Nested Schema Pruning not Working in Window Functions

2020-06-22 Thread Frank Yin (Jira)
Frank Yin created SPARK-32059: - Summary: Nested Schema Pruning not Working in Window Functions Key: SPARK-32059 URL: https://issues.apache.org/jira/browse/SPARK-32059 Project: Spark Issue Type: B

[jira] [Comment Edited] (SPARK-25165) Cannot parse Hive Struct

2018-08-20 Thread Frank Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586901#comment-16586901 ] Frank Yin edited comment on SPARK-25165 at 8/21/18 3:48 AM:

[jira] [Comment Edited] (SPARK-25165) Cannot parse Hive Struct

2018-08-20 Thread Frank Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586901#comment-16586901 ] Frank Yin edited comment on SPARK-25165 at 8/21/18 3:48 AM:

[jira] [Comment Edited] (SPARK-25165) Cannot parse Hive Struct

2018-08-20 Thread Frank Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586901#comment-16586901 ] Frank Yin edited comment on SPARK-25165 at 8/21/18 3:47 AM:

[jira] [Commented] (SPARK-25165) Cannot parse Hive Struct

2018-08-20 Thread Frank Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586901#comment-16586901 ] Frank Yin commented on SPARK-25165: --- #!/usr/bin/env python # -*- coding: UTF-8 -*- # e

[jira] [Created] (SPARK-25165) Cannot parse Hive Struct

2018-08-20 Thread Frank Yin (JIRA)
Frank Yin created SPARK-25165: - Summary: Cannot parse Hive Struct Key: SPARK-25165 URL: https://issues.apache.org/jira/browse/SPARK-25165 Project: Spark Issue Type: Bug Components: SQL