Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-16 Thread Robert Metzger
I guess you are seeing a different error now, because you are submitting the job, and stopping it right away. Can you produce new logs, where you wait until at least one Checkpoint successfully completed before you stop? >From the exception it seems that the job has not successfully been initializ

Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-16 Thread Folani
Hi, I attached the log files for Jobmanager and Taskmanager: jobmanager_log.asc 6122-f8b99d_log.6122-f8b99d_log

Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-16 Thread Robert Metzger
Hi, the logs from the client are not helpful for debugging this particular issue. With kubectl get pods, you can get the TaskManger pod names, with kubectl logs you can get the logs. The JobManager log would also be nice to have. On Mon, Dec 14, 2020 at 3:29 PM Folani wrote: > Hi Piotrek, > >

Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-14 Thread Folani
Hi Piotrek, Sorry for late response. I have another problem with setting logs. I think the logging issue comes from using Flink on my host machine and running a job on a jobmanager in K8s. I'm managing the issue. But, this is what I got in /log folder of my host machine: 2020-12-14 15:04:51,329

Re: Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-11 Thread Piotr Nowojski
Hi, It's hard for me to guess what could be the problem. There was the same error reported a couple of months ago [1], but there is frankly no extra information there. Can we start from looking at the full TaskManager and JobManager logs? Could you share them with us? Best, Piotrek [1] http://

Getting an exception while stopping Flink with savepoints on Kubernetes+Minio

2020-12-11 Thread Folani
I'm deploying a standalone Flink cluster on top of Kubernetes and using MinIO as a S3 backend. I mainly follow the instructions in flink's website. I use the following command to run my job in Flink: $flink run -d -m : -j job.jar I also have added to flink-configmap.yaml the followings: s