GitHub user mxm opened a pull request:
https://github.com/apache/flink/pull/2313
[FLINK-4273] Modify JobClient to attach to running jobs
These changes are required for FLINK-4272 (introduce a JobClient class
for job control). Essentially, we want to be able to re-attach to a
running job and monitor it. It shouldn't make any difference whether we
just submitted the job or we recover it from an existing JobID.
This PR modifies the JobClientActor to support two different operation
modes: a) submitJob and monitor b) re-attach to job and monitor
The JobClient class has been updated with methods to access this
functionality. Before it just had `submitJobAndWait` and
`submitJobDetachd`. Additionally, it has `submitJob` and
`attachToRunningJob` and `awaitJobResult`.
`submitJob` -> Submit job and return a future which can be completed to
get the result with `awaitJobResult`
`attachToRunningJob` -> Re-attached the JobClientActor to a runnning
job, registering at the JobManager and downloading its class loader
`awaitJobResult` -> Blocks until the returned future from either
`submitJob` or `attachToRunningJob` has been completed
TODO
- missing integration test to test downloading of the user code
class loader from the JobManager and to end-to-end test the
re-attachment.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mxm/flink FLINK-4273
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2313.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2313
----
commit 7832810728abea5824e2fe0d9e9dc75b14ef61af
Author: Maximilian Michels <m...@apache.org>
Date: 2016-07-29T15:37:41Z
[FLINK-4273] Modify JobClient to attach to running jobs
These changes are required for FLINK-4272 (introduce a JobClient class
for job control). Essentially, we want to be able to re-attach to a
running job and monitor it. It shouldn't make any difference whether we
just submitted the job or we recover it from an existing JobID.
This PR modifies the JobClientActor to support two different operation
modes: a) submitJob and monitor b) re-attach to job and monitor
The JobClient class has been updated with methods to access this
functionality. Before it just had `submitJobAndWait` and
`submitJobDetachd`. Additionally, it has `submitJob` and
`attachToRunningJob` and `awaitJobResult`.
`submitJob` -> Submit job and return a future which can be completed to
get the result with `awaitJobResult`
`attachToRunningJob` -> Re-attached the JobClientActor to a runnning
job, registering at the JobManager and downloading its class loader
`awaitJobResult` -> Blocks until the returned future from either
`submitJob` or `attachToRunningJob` has been completed
TODO
- missing integration test to test downloading of the user code
class loader from the JobManager and to end-to-end test the
re-attachment.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
