[
https://issues.apache.org/jira/browse/SINGA-113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15072382#comment-15072382
]
ASF subversion and git services commented on SINGA-113:
-------------------------------------------------------
Commit bf4cd3bc9473d802d97327226c636ddc442cda0f in incubator-singa's branch
refs/heads/master from [~flytosky]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=bf4cd3b ]
SINGA-113 Model/Hybrid Partition Support
Update memory copy in SliceLayer and ConcateLayer considering cpu (memcpy) and
gpu (cudaMemcpy).
Test hybrid partition running on GPU (CUDNN) using cudnn_hybrid.conf
> Model/Hybrid Partition Support
> ------------------------------
>
> Key: SINGA-113
> URL: https://issues.apache.org/jira/browse/SINGA-113
> Project: Singa
> Issue Type: Bug
> Reporter: Sheng Wang
> Assignee: Sheng Wang
>
> This ticket is to add model partition and hybrid partition.
> model/hybrid partitions are achieved by adding assistant connection layers in
> original neuralnet model to handle data/gradient messages between two
> connected layers but on different machines.
> The partition is transparent to users.
> User just need to configure partition_dim field in NetProto:
> partition_dim = 0 : data partition
> partition_dim = 1 : model partition
> User can overwrite partition_dim for a specific layer in LayerProto with the
> same manner. This will result in hybrid partition.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
