[
https://issues.apache.org/jira/browse/HAMA-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651271#comment-14651271
]
Edward J. Yoon edited comment on HAMA-901 at 8/2/15 11:34 PM:
--------------------------------------------------------------
Here's another idea. Instead of launching two jobs, at first superstep, we can
split the tasks into 2 more worker groups, and manage them as an logical two
different BSP jobs using region barrier synchronization. This idea can be used
for HAMA-961. DistBelief uses BSP paradigm among small worker groups for model
parallel.
was (Author: udanax):
Here's another idea. Instead of launching two jobs, at first superstep, we can
split the tasks into 2 more worker groups, and manage them as an logical two
different BSP jobs using regional barrier synchronizations. This idea can be
used for HAMA-961. DistBelief uses BSP paradigm among small worker groups for
model parallel.
> Multi-job configuration interface for communicate among jobs.
> -------------------------------------------------------------
>
> Key: HAMA-901
> URL: https://issues.apache.org/jira/browse/HAMA-901
> Project: Hama
> Issue Type: New Feature
> Components: bsp core
> Affects Versions: 0.7.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.8.0
>
>
> I'm thinking about adding multi-job configuration interface for communicate
> among multiple jobs. My main purpose is for launching two infinite real-time
> data processing BSP job and incremental learning BSP job.
> I guess it's not difficult since we don't have message security yet.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)