GitHub user nltran opened a pull request:
https://github.com/apache/flink/pull/967
Stale Synchronous Parallel Iterations
Here is a pull request containing our development on [Stale Synchronous
Parallel
(SSP)](http://reports-archive.adm.cs.cmu.edu/anon/ml2013/CMU-ML-13-103.pdf)
iterations. The pull request contains:
* Code supporting SSP
* API to configure and enable SSP from the ExecutionEnvironment
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nltran/flink SSP
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/967.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #967
----
commit 0435bb9114f48aeefb330e7cf92610be84f79c81
Author: Nam-Luc Tran <[email protected]>
Date: 2015-07-31T15:21:08Z
* Added the model for parameter server and parameter element
* Added parameter server implementation based on Apache Ignite
* Started instance of parameter server in TaskManager
* Added Apache Ignite as dependency in pom.xml
commit decc66db856d3d640e7e29128e2696c0941091dd
Author: Nam-Luc Tran <[email protected]>
Date: 2015-07-31T15:24:32Z
* Extended RichMapFunction with methods to access parameter server
commit 55398da553ce697af9bea881ea7131818edb82d2
Author: Nam-Luc Tran <[email protected]>
Date: 2015-07-31T15:25:08Z
* Extended DataSet API to enable SSP and configuration
commit 6ef80ceac5e6ef897769e1883823d152d0c04070
Author: Nam-Luc Tran <[email protected]>
Date: 2015-07-31T15:25:55Z
* Extended ExecutionEnvironment and ExecutionConfig to enable SSP and SPP
configuration
commit 368ca1c101034aefa8b6ac0ce4791133976831e0
Author: Nam-Luc Tran <[email protected]>
Date: 2015-07-31T15:29:29Z
* Added drop-in control structures for Stale Synchronous Parallel iterations
commit 23fb6518fe7042ad859bb9474266131f2bdb669c
Author: Nam-Luc Tran <[email protected]>
Date: 2015-07-31T15:30:31Z
* Added the events used by the control structures for Stale Synchronous
Parallel iterations
commit 48810bde7783610112751f2221126b69a1ac9b56
Author: Nam-Luc Tran <[email protected]>
Date: 2015-07-31T15:32:02Z
* Extended the job translation to take into account the control structures
related to Stale Synchronous Parallel Iterations
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
