Hi Brendan, I think you may need to confirm which stage the job is blocked, the client is submitting job or resourcemanage is scheduling job or tasks are launching in TM? May be you need provide more information to help us to figure the issue
Best, Shammon FY On Tuesday, June 27, 2023, Weihua Hu <huweihua....@gmail.com> wrote: > Hi, Brendan > > It looks like it's invoking your main method referring to the log. You can > add more logs in the main method to figure out which part takes too long. > > Best, > Weihua > > > On Tue, Jun 27, 2023 at 5:06 AM Brendan Cortez < > brendan.cortez...@gmail.com> wrote: > >> No, I'm using a collection source + 20 same JDBC lookups + Kafka sink. >> >> On Mon, 26 Jun 2023 at 19:17, Yaroslav Tkachenko <yaros...@goldsky.com> >> wrote: >> >>> Hey Brendan, >>> >>> Do you use a file source by any chance? >>> >>> On Mon, Jun 26, 2023 at 4:31 AM Brendan Cortez < >>> brendan.cortez...@gmail.com> wrote: >>> >>>> Hi all! >>>> >>>> I'm trying to submit a Flink Job in Application Mode in the Kubernetes >>>> cluster. >>>> >>>> I see some problems when an application has a big number of operators >>>> (more than 20 same operators) - it freezes for ~6 minutes after >>>> *2023-06-21 15:46:45,082 WARN >>>> org.apache.flink.connector.kafka.sink.KafkaSinkBuilder [] - Property >>>> [transaction.timeout.ms <http://transaction.timeout.ms/>] not specified. >>>> Setting it to PT1H* >>>> and until >>>> >>>> *2023-06-21 15:53:20,002 INFO >>>> org.apache.flink.streaming.api.graph.StreamGraphGenerator [] - Disabled >>>> Checkpointing. Checkpointing is not supported and not needed when executing >>>> jobs in BATCH mode.*(logs in attachment) >>>> >>>> When I set log.level=DEBUG, I see only this message each 10 seconds: >>>> *2023-06-21 14:51:30,921 DEBUG >>>> org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - >>>> Trigger heartbeat request.* >>>> >>>> Please, could you help me understand the cause of this problem and how >>>> to fix it. I use the Flink 1.15.3 version. >>>> >>>> Thank you in advance! >>>> >>>> Best regards, >>>> Brendan Cortez. >>>> >>>
