Re: [DISCUSS] FLIP-438: Make Flink's Hadoop and YARN configuration probing consistent

2024-04-18 Thread Ferenc Csaky
Hi Venkata krishnan, My general point was that personally I do not think that the current implementation is wrong or confusing. And the main thing here is that how we define consistent in this case is subjective. >From the proposed point of view, consistent mean we use the same prefix. But we can

Re: [DISCUSS] FLIP-438: Make Flink's Hadoop and YARN configuration probing consistent

2024-04-15 Thread Venkatakrishnan Sowrirajan
Sorry for the late reply, Ferenc. I understand the rationale behind the current implementation as the problem is slightly different b/w yarn (always prefixed with `yarn`) and hadoop (it is not guaranteed all `hadoop` configs will be prefixed by `hadoop`) configs. >From the dev UX perspective, it

Re: [DISCUSS] FLIP-438: Make Flink's Hadoop and YARN configuration probing consistent

2024-04-03 Thread Ferenc Csaky
Hi Venkata, Thank you for opening the discussion about this! After taking a look at the YARN and Hadoop configurations, the reason why it was implemented this way is that, in case of YARN, every YARN-specific property is prefixed with "yarn.", so to get the final, YARN-side property it is enough