[Issue] Failure on stopping Flink(1.17) application

2023-08-17 Thread Dennis Jung
Hello people, I'm facing failure when I try to stop running Flink job with REST API 'jobs/:jobid/stop' ``` ... java.util.concurrent.CompletionException: org.apache.flink.runtime.checkpoint.CheckpointException: Task has failed. java.base/java.util.concurrent.CompletableFuture.encodeRelay(Unknown

RE: Flink AVRO to Parquet writer - Row group size/Page size

2023-08-17 Thread Kamal Mittal via user
Hello Community, Please share views for below. Rgds, Kamal From: Kamal Mittal Sent: 17 August 2023 08:01 AM To: Kamal Mittal ; user@flink.apache.org Subject: RE: Flink AVRO to Parquet writer - Row group size/Page size Hello Community, Please share views for below. Rgds, Kamal From: Kamal Mi

Re: [Question] Good way to monitor data skewness

2023-08-17 Thread Dennis Jung
Hello, Thanks for feedback. I'll try to add setup in the internal Grafana. BR, JUNG 2023년 8월 16일 (수) 오후 6:29, Hang Ruan 님이 작성: > Hi, Dennis. > > As Ron said, we could judge this situation by the metrics. > We are usually reporting the metrics to the external system like > Prometheus by the metr

Re: 404 Jar File Not Found w/ Web Submit Disabled

2023-08-17 Thread jiadong.lu
Hi Patricia Sorry for giving wrong advice. I tried the url path of "/v1/jar/upload" and it did respond the same 404. For now, we may sure that '/jar/upload' cannot work with the configuration of `web.ui.submit=false` . If you really need to disable `web.ui.submit`configuration, maybe you shou

Re: 404 Jar File Not Found w/ Web Submit Disabled

2023-08-17 Thread jiadong.lu
Hi Patricia Have you tried the url path of '/v1/jars/upload' ? Best Jiadong Lu On 2023/8/16 14:00, patricia lee wrote: Hi, Below are the steps that I take to replicate the issue. I have a requirement to disable both the capability to run and submit jobs in Flink Web UI and Rest Endpoint. I