[jira] [Updated] (FLINK-33944) Apache Flink: Process to restore more than one job on job manager startup from the respective savepoints
[ https://issues.apache.org/jira/browse/FLINK-33944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-33944: --- Issue Type: New Feature (was: Bug) > Apache Flink: Process to restore more than one job on job manager startup > from the respective savepoints > > > Key: FLINK-33944 > URL: https://issues.apache.org/jira/browse/FLINK-33944 > Project: Flink > Issue Type: New Feature > Components: Runtime / Checkpointing >Affects Versions: 1.18.0 >Reporter: Vijay >Priority: Major > > > We are using Flink (1.18) version for our Flink cluster. The job manager has > been deployed in "Application mode" and we are looking for a process to > restore multiple jobs (using their respective savepoint directories) when the > job manager is started. Currently, we have the option to restore only one job > while running "standalone-job.sh" using the --fromSavepoint and > --allowNonRestoredState. However, we need a way to trigger multiple job > executions via Java client (from its respective savepoint location) on > Jobmanager startup. > Note: We are not using a Kubernetes native deployment, but we are using k8s > standalone mode of deployment. > Additional Query: If there is a process to restore multiple jobs from its > respective savepoints on "Application mode" of deployment, is the same > supported on Session mode of deployment or not? > *Expected process:* > # Before starting with the Flink/application image upgrade, trigger the > savepoints for all the current running jobs. > # Once the savepoints process completed for all jobs, will trigger the scale > down of job manager and task manager instances. > # Update the image version on the k8s deployment with the update application > image. > # After image version is updated, scale up the job manager and task manager. > # We need a process to restore the previously running jobs from the > savepoint dir and start all the jobs. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-33944) Apache Flink: Process to restore more than one job on job manager startup from the respective savepoints
[ https://issues.apache.org/jira/browse/FLINK-33944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay updated FLINK-33944: -- Description: We are using Flink (1.18) version for our Flink cluster. The job manager has been deployed in "Application mode" and we are looking for a process to restore multiple jobs (using their respective savepoint directories) when the job manager is started. Currently, we have the option to restore only one job while running "standalone-job.sh" using the --fromSavepoint and --allowNonRestoredState. However, we need a way to trigger multiple job executions via Java client (from its respective savepoint location) on Jobmanager startup. Note: We are not using a Kubernetes native deployment, but we are using k8s standalone mode of deployment. Additional Query: If there is a process to restore multiple jobs from its respective savepoints on "Application mode" of deployment, is the same supported on Session mode of deployment or not? *Expected process:* # Before starting with the Flink/application image upgrade, trigger the savepoints for all the current running jobs. # Once the savepoints process completed for all jobs, will trigger the scale down of job manager and task manager instances. # Update the image version on the k8s deployment with the update application image. # After image version is updated, scale up the job manager and task manager. # We need a process to restore the previously running jobs from the savepoint dir and start all the jobs. was: We are using Flink (1.18) version for our Flink cluster. The job manager has been deployed in "Application mode" and we are looking for a process to restore multiple jobs (using their respective savepoint directories) when the job manager is started. Currently, we have the option to restore only one job while running "standalone-job.sh" using the --fromSavepoint and --allowNonRestoredState. However, we need a way to trigger multiple job executions via Java client. Note: We are not using a Kubernetes native deployment, but we are using k8s standalone mode of deployment. Additional Query: If there is a process to restore multiple jobs from its respective savepoints on "Application mode" of deployment, is the same supported on Session mode of deployment or not? *Expected process:* # Before starting with the Flink/application image upgrade, trigger the savepoints for all the current running jobs. # Once the savepoints process completed for all jobs, will trigger the scale down of job manager and task manager instances. # Update the image version on the k8s deployment with the update application image. # After image version is updated, scale up the job manager and task manager. # We need a process to restore the previously running jobs from the savepoint dir and start all the jobs. > Apache Flink: Process to restore more than one job on job manager startup > from the respective savepoints > > > Key: FLINK-33944 > URL: https://issues.apache.org/jira/browse/FLINK-33944 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing >Affects Versions: 1.18.0 >Reporter: Vijay >Priority: Major > > > We are using Flink (1.18) version for our Flink cluster. The job manager has > been deployed in "Application mode" and we are looking for a process to > restore multiple jobs (using their respective savepoint directories) when the > job manager is started. Currently, we have the option to restore only one job > while running "standalone-job.sh" using the --fromSavepoint and > --allowNonRestoredState. However, we need a way to trigger multiple job > executions via Java client (from its respective savepoint location) on > Jobmanager startup. > Note: We are not using a Kubernetes native deployment, but we are using k8s > standalone mode of deployment. > Additional Query: If there is a process to restore multiple jobs from its > respective savepoints on "Application mode" of deployment, is the same > supported on Session mode of deployment or not? > *Expected process:* > # Before starting with the Flink/application image upgrade, trigger the > savepoints for all the current running jobs. > # Once the savepoints process completed for all jobs, will trigger the scale > down of job manager and task manager instances. > # Update the image version on the k8s deployment with the update application > image. > # After image version is updated, scale up the job manager and task manager. > # We need a process to restore the previously running jobs from the > savepoint dir and start all the jobs. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-33944) Apache Flink: Process to restore more than one job on job manager startup from the respective savepoints
[ https://issues.apache.org/jira/browse/FLINK-33944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay updated FLINK-33944: -- Description: We are using Flink (1.18) version for our Flink cluster. The job manager has been deployed in "Application mode" and we are looking for a process to restore multiple jobs (using their respective savepoint directories) when the job manager is started. Currently, we have the option to restore only one job while running "standalone-job.sh" using the --fromSavepoint and --allowNonRestoredState. However, we need a way to trigger multiple job executions via Java client. Note: We are not using a Kubernetes native deployment, but we are using k8s standalone mode of deployment. Additional Query: If there is a process to restore multiple jobs from its respective savepoints on "Application mode" of deployment, is the same supported on Session mode of deployment or not? *Expected process:* # Before starting with the Flink/application image upgrade, trigger the savepoints for all the current running jobs. # Once the savepoints process completed for all jobs, will trigger the scale down of job manager and task manager instances. # Update the image version on the k8s deployment with the update application image. # After image version is updated, scale up the job manager and task manager. # We need a process to restore the previously running jobs from the savepoint dir and start all the jobs. was: We are using Flink (1.18) version for our Flink cluster. The job manager has been deployed in "Application mode" and we are looking for a process to restore multiple jobs (using their respective savepoint directories) when the job manager is started. Currently, we have the option to restore only one job while running "standalone-job.sh" using the --fromSavepoint and --allowNonRestoredState. However, we need a way to trigger multiple job executions via Java client. Note: We are not using a Kubernetes native deployment, but we are using k8s standalone mode of deployment. *Expected process:* # Before starting with the Flink/application image upgrade, trigger the savepoints for all the current running jobs. # Once the savepoints process completed for all jobs, will trigger the scale down of job manager and task manager instances. # Update the image version on the k8s deployment with the update application image. # After image version is updated, scale up the job manager and task manager. # We need a process to restore the previously running jobs from the savepoint dir and start all the jobs. > Apache Flink: Process to restore more than one job on job manager startup > from the respective savepoints > > > Key: FLINK-33944 > URL: https://issues.apache.org/jira/browse/FLINK-33944 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing >Affects Versions: 1.18.0 >Reporter: Vijay >Priority: Major > > > We are using Flink (1.18) version for our Flink cluster. The job manager has > been deployed in "Application mode" and we are looking for a process to > restore multiple jobs (using their respective savepoint directories) when the > job manager is started. Currently, we have the option to restore only one job > while running "standalone-job.sh" using the --fromSavepoint and > --allowNonRestoredState. However, we need a way to trigger multiple job > executions via Java client. > Note: We are not using a Kubernetes native deployment, but we are using k8s > standalone mode of deployment. > Additional Query: If there is a process to restore multiple jobs from its > respective savepoints on "Application mode" of deployment, is the same > supported on Session mode of deployment or not? > *Expected process:* > # Before starting with the Flink/application image upgrade, trigger the > savepoints for all the current running jobs. > # Once the savepoints process completed for all jobs, will trigger the scale > down of job manager and task manager instances. > # Update the image version on the k8s deployment with the update application > image. > # After image version is updated, scale up the job manager and task manager. > # We need a process to restore the previously running jobs from the > savepoint dir and start all the jobs. -- This message was sent by Atlassian Jira (v8.20.10#820010)
