[ https://issues.apache.org/jira/browse/SPARK-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron Davidson updated SPARK-3796: ---------------------------------- Description: This task will be broken up into two parts -- the first, being to refactor our internal shuffle service to use a BlockTransferService which we can easily extract out into its own service, and then the second is to actually do the extraction. Here is the design document for the low-level service, nicknamed "Sluice", on top of which will be Spark's BlockTransferService API: https://docs.google.com/document/d/1zKf3qloBu3dmv2AFyQTwEpumWRPUT5bcAUKB5PGNfx0 > Create shuffle service for external block storage > ------------------------------------------------- > > Key: SPARK-3796 > URL: https://issues.apache.org/jira/browse/SPARK-3796 > Project: Spark > Issue Type: Sub-task > Components: Spark Core > Reporter: Patrick Wendell > Assignee: Aaron Davidson > > This task will be broken up into two parts -- the first, being to refactor > our internal shuffle service to use a BlockTransferService which we can > easily extract out into its own service, and then the second is to actually > do the extraction. > Here is the design document for the low-level service, nicknamed "Sluice", on > top of which will be Spark's BlockTransferService API: > https://docs.google.com/document/d/1zKf3qloBu3dmv2AFyQTwEpumWRPUT5bcAUKB5PGNfx0 -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org