Re: Batch Job with Adaptive Batch Scheduler failing with JobInitializationException: Could not start the JobMaster

Hi Dipak, Regarding question 1, I noticed from the logs that the method createBatchExecutionEnvironment from Beam is being used in your job. IIUC, this method utilizes Flink's DataSet API. If indeed the DataSet API is being used, the configuration option execution.batch-shuffle-mode will not take

Batch Job with Adaptive Batch Scheduler failing with JobInitializationException: Could not start the JobMaster

Hi Everyone I am facing some issues while running the batch job on a Flink cluster using Adaptive Batch Scheduler. I have deployed a flink cluster on Kubernetes using the flink Kubernetes operator and submitted a job to the cluster using Apache beam FlinkRunner. I am using Flink version 1.16. I