Hi Sourabh, do you have access to the cluster logs? They could be helpful for debugging the problem. Which version of Flink are you using?
Cheers, Till On Wed, Jun 17, 2020 at 7:39 PM Sourabh Mehta <sourabhmehta2...@gmail.com> wrote: > No, I am not. > > On Wed, 17 Jun 2020 at 10:48 PM, Chesnay Schepler <ches...@apache.org> > wrote: > >> Are you by any chance creating a local environment via >> (Stream)ExecutionEnvironment#createLocalEnvironment? >> >> On 17/06/2020 17:05, Sourabh Mehta wrote: >> >> Hi Team, >> >> I'm exploring flink for one of my use case, I'm facing some issues >> while running a flink job in cluster mode. Below are the steps I followed >> to setup and run job in cluster mode : >> 1. Setup flink on google cloud dataproc using >> https://github.com/GoogleCloudDataproc/initialization-actions/tree/master/flink >> >> 2. After setting up the cluster I could see the flink session started and >> could see the UI for the same. >> >> 3 Submitted job from dataproc master node using below command >> >> sudo HADOOP_CONF_DIR=/etc/hadoop/conf /usr/lib/flink/bin/flink run -m >> yarn-cluster -yid application_1592311654771_0001 -class >> com.sm.flink.FlinkDriver /usr/lib/flink/lib/flink-1.0.10-sm-SNAPSHOT.jar >> hdfs://cluster-flink-poc-m:8020/user/flink/rocksdb/ >> >> After running the job I see the job started successfully but created a >> mini local cluster and ran in local mode. I don't see any jobs submitted to >> JobManger and I also see 0 task managers on UI. >> >> Can someone please help me understand here?, do let me know what input >> is required to investigate the same. >> >> >> >> >>
