What we could also add to make this a bit more generic and extensible is to create some interfaces for reconfiguring the StreamExecutionEnvironment, ExecutionConfig etc and let users specify a class the implements the reconfiguration logic based on the flink configuration.
This could be executed after the default behaviour that you outlined in the FLIP. What do you think? Gyula On Thu, Aug 29, 2019 at 7:21 PM Gyula Fóra <gyula.f...@gmail.com> wrote: > Hi! > > Huuuge +1 from me, this has been an operational pain for years. > This would also introduce a nice and simple way to extend it in the future > if we need. > > Ship it! > > Gyula > > On Thu, Aug 29, 2019 at 5:05 PM Dawid Wysakowicz <dwysakow...@apache.org> > wrote: > >> Hi, >> >> I wanted to propose a new, additional way of configuring execution >> parameters that can currently be set only on such objects like >> ExecutionConfig, CheckpointConfig and StreamExecutionEnvironment. This >> poses problems such as: >> >> - no easy way to configure those from a file >> - there is no easy way to pass a configuration from layers built on >> top of StreamExecutionEnvironment. (e.g. when we want to configure those >> options from TableEnvironment) >> - they are not automatically documented >> >> Note that there are a few concepts from FLIP-54[1] that this FLIP is >> based on. >> >> Would be really grateful to know if you think this would be a valuable >> addition and any other feedback. >> >> Best, >> >> Dawid >> >> Wiki page: >> https://cwiki.apache.org/confluence/display/FLINK/FLIP-59%3A+Enable+execution+configuration+from+Configuration+object >> >> Google doc: >> https://docs.google.com/document/d/1l8jW2NjhwHH1mVPbLvFolnL2vNvf4buUMDZWMfN_hFM/edit?usp=sharing >> >> >> [1] >> https://cwiki.apache.org/confluence/display/FLINK/FLIP-54%3A+Evolve+ConfigOption+and+Configuration >> >> >>
