[jira] [Updated] (SPARK-3133) Piggyback get location RPC call to fetch small blocks
[ https://issues.apache.org/jira/browse/SPARK-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3133: - Component/s: Block Manager > Piggyback get location RPC call to fetch small blocks > - > > Key: SPARK-3133 > URL: https://issues.apache.org/jira/browse/SPARK-3133 > Project: Spark > Issue Type: Sub-task > Components: Block Manager >Reporter: Reynold Xin >Assignee: Reynold Xin > > We should add a new API to the BlockManagerMasterActor to get location or the > data block directly if the data block is small. > This effectively makes TorrentBroadcast behaves similarly to HttpBroadcast > for small blocks. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-3133) Piggyback get location RPC call to fetch small blocks
[ https://issues.apache.org/jira/browse/SPARK-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3133: --- Description: We should add a new API to the BlockManagerMasterActor to get location or the data block directly if the data block is small. This effectively makes TorrentBroadcast behaves similarly to HttpBroadcast for small blocks. was: We should add a new API to the BlockManagerMasterActor to get location or the data block directly if the data block is small. This effectively makes TorrentBroadcast behaves similarly to HttpBroadcast. > Piggyback get location RPC call to fetch small blocks > - > > Key: SPARK-3133 > URL: https://issues.apache.org/jira/browse/SPARK-3133 > Project: Spark > Issue Type: Sub-task >Reporter: Reynold Xin > > We should add a new API to the BlockManagerMasterActor to get location or the > data block directly if the data block is small. > This effectively makes TorrentBroadcast behaves similarly to HttpBroadcast > for small blocks. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-3133) Piggyback get location RPC call to fetch small blocks
[ https://issues.apache.org/jira/browse/SPARK-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3133: --- Description: We should add a new API to the BlockManagerMasterActor to get location or the data block directly if the data block is small. This effectively makes TorrentBroadcast behaves similarly to HttpBroadcast. was: We should add a new API to the BlockManagerMasterActor to get location or the data block directly if the data block is small. Once we use this, this effectively makes TorrentBroadcast behaves similarly to HttpBroadcast. > Piggyback get location RPC call to fetch small blocks > - > > Key: SPARK-3133 > URL: https://issues.apache.org/jira/browse/SPARK-3133 > Project: Spark > Issue Type: Sub-task >Reporter: Reynold Xin > > We should add a new API to the BlockManagerMasterActor to get location or the > data block directly if the data block is small. > This effectively makes TorrentBroadcast behaves similarly to HttpBroadcast. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
