I am deploying as a docker on our servers, due to some restrictions I can only pass Keystore URLs.
one option is yarn.ship-files !. can you help me with pointing to the sample code, and how job manager can ship this file? download as part of job's main function and send to all task managers.. will this work? On Mon, Apr 18, 2022 at 10:10 PM Austin Cawley-Edwards < austin.caw...@gmail.com> wrote: > If you are using Kubernetes to deploy Flink, you could think about an > initContainer on the TMs or a custom Docker entry point that does this > initialization. > > Best, > Austin > > On Mon, Apr 18, 2022 at 7:49 AM huweihua <huweihua....@gmail.com> wrote: > >> Hi, Init stuff when task manager comes up is not an option. >> But if the Keystore file is not changeable and you are using yarn mode, >> maybe you can use ‘yarn.ship-files’[1] to localize it. >> >> [1] >> https://nightlies.apache.org/flink/flink-docs-master/zh/docs/deployment/config/#yarn-ship-files >> >> 2022年4月16日 下午11:44，Great Info <gubt...@gmail.com> 写道： >> >> I need to download Keystore and use it while creating the source >> connector, currently, I am overriding the open method >> <https://github.com/apache/flink/blob/99c2a415e9eeefafacf70762b6f54070f7911ceb/flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBase.java#L560> >> but >> this gets called for each of my source connectors. >> >> @Override >> public void open(Configuration configuration) throws Exception { >> >> // do few things like download Keystore to default path etc >> super.open(configuration) >> } >> >> Is there an option to init a few pre stuff as soon as the task manager >> comes up? >> >> >>
