Hi Garret, My responses hitherto indicate that I'm currently focusing on setting up a CI for Windows for building Hadoop and getting the unit tests to run on it. I believe, without these, no matter the improvements, the build is bound to be broken someday. I would thus like to prioritize setting up of the CI over deprecation of winutils.
However, I don't see anyone stopping you from working on removing winutils. I encourage you to put across a PR and I would be glad to review the same. One question I've is - how will you validate that your changes work fine and don't regress the existing functionality, given that we don't yet have a CI for Hadoop on Windows? Thanks, --Gautham On Mon, 28 Nov 2022 at 23:42, Garret Wilson <gar...@globalmentor.com> wrote: > On 11/14/2022 12:04 PM, Gautham Banasandra wrote: > > … > I would like to aim for winutils deprecation by the end of the first > quarter of 2023. > > The key word is "deprecation". Note that the sentence doesn't say the > references in the code to Winutils will be removed by this time. I offered > to remove it immediately. (What's the point of "deprecating" it when it's > an an extra step you're forcing people to take to begin with? Just rip out > the references.) > > … I feel it's a bit > ambitious. But if things fall into place … > > Hardly anything ever "falls into place" the way it is expected. > > Peeps, I'm going to leave this list for the moment because it's bringing a > lot of clutter to my inbox. Let me just summarize: > > - I pointed out that Winutils, however much it was a necessary evil at > the time, needs to go, and go now. I implemented a completely working first > version wrapper. I offered to finish the work by revamping the actual > Apache code. > - Many people said, "Oh, we're already working on that; hold our beer > [that's an expression, for those who may not know] and soon it will be > done!" > - As the months and years roll on and everything remains as it is > (I'll be happy if you prove me wrong), don't forget about me and feel free > to reach out. I'll probably still be eager to fix the Apache code itself it > if someone can figure out a way that I won't have to do it for free and > live half a year off savings to do it. > > Best, > > Garret >
