Re: How do I get the IP of the master and slave files programmatically in Flink?

I'm not quite familiar with that. I'd like to cc @Aljoscha Krettek here. Best, Yangze Guo On Mon, May 25, 2020 at 4:39 PM Felipe Gutierrez wrote: > > ok, I see. > > Do you suggest a better approach to send messages from the JobManager > to the TaskManagers and my specific operator? > > Thanks,

Re: How do I get the IP of the master and slave files programmatically in Flink?

ok, I see. Do you suggest a better approach to send messages from the JobManager to the TaskManagers and my specific operator? Thanks, Felipe -- -- Felipe Gutierrez -- skype: felipe.o.gutierrez -- https://felipeogutierrez.blogspot.com On Mon, May 25, 2020 at 4:23 AM Yangze Guo wrote: > > Glad

Re: How do I get the IP of the master and slave files programmatically in Flink?

Glad to see that! However, I was told that it is not the right approach to directly extend `AbstractUdfStreamOperator` in DataStream API. This would be fixed at some point (maybe Flink 2.0). The JIRA link is [1]. [1] https://issues.apache.org/jira/browse/FLINK-17862 Best, Yangze Guo On Fri,

Re: How do I get the IP of the master and slave files programmatically in Flink?

thanks. it worked! I add the following method at the org.apache.flink.streaming.api.operators.StreamingRuntimeContext class: public Environment getTaskEnvironment() { return this.taskEnvironment; } Then I am getting the IP using: ConfigOption restAddressOption = ConfigOptions

Re: How do I get the IP of the master and slave files programmatically in Flink?

Hi, Felipe I see your problem. IIUC, if you use AbstractUdfStreamOperator, you could indeed get all the configurations(including what you defined in flink-conf.yaml) through "AbstractUdfStreamOperator#getRuntimeContext().getTaskManagerRuntimeInfo().getConfiguration()". However, I guess it is not

Re: How do I get the IP of the master and slave files programmatically in Flink?

Hi all, I would like to have the IP of the JobManager, not the Task Executors. I explain why. I have an operator (my own operator that extends AbstractUdfStreamOperator) that sends and receives messages from a global controller. So, regardless of which TaskManager these operator instances are

Re: How do I get the IP of the master and slave files programmatically in Flink?

Hi, Felipe Do you mean to get the Host and Port of the task executor where your operator is indeed running on? If that is the case, IIUC, two possible components that contain this information are RuntimeContext and the Configuration param of RichFunction#open. After reading the relevant code

Re: How do I get the IP of the master and slave files programmatically in Flink?

Hi Felippe, could you clarify in some more details what you are trying to achieve? Best regards, -- Alexander Fedulov | Solutions Architect +49 1514 6265796 Follow us @VervericaData -- Join Flink Forward - The Apache Flink

How do I get the IP of the master and slave files programmatically in Flink?

Hi all, I have my own operator that extends the AbstractUdfStreamOperator class and I want to issue some messages to it. Sometimes the operator instances are deployed on different TaskManagers and I would like to set some attributes like the master and slave IPs on it. I am trying to use these

Re: Master and Slave files

Thanks for confirming, Nico  On Wed, Mar 28, 2018 at 3:57 PM Nico Kruber wrote: > If you refer to the files under the conf folder, these are only used by > the standalone cluster startup scripts, i.e. bin/start-cluster.sh and > bin/stop-cluster.sh > > > Nico > > On

Re: Master and Slave files

If you refer to the files under the conf folder, these are only used by the standalone cluster startup scripts, i.e. bin/start-cluster.sh and bin/stop-cluster.sh Nico On 28/03/18 12:27, Alexander Smirnov wrote: > Hi, > > are the files needed only on cluster startup stage? > are they only used

Master and Slave files

Hi, are the files needed only on cluster startup stage? are they only used by bash scripts? Alex