Hi everybody, tried to polish https://docs.google.com/document/d/1fI1mvbR1mFLV6ohU5cIEnU5hFvEE7EWnKYWOkF55jtE, adding comments from past email threads and what we discussed recently. The whole document is more a story than a step-by-step guide (as we already discussed), but I think that each environment to upgrade is different from others so it is difficult to come up with a general procedure. I tried to add all the little details and gotchas that I wished to know while preparing the upgrade, let me know what you think about it :)
I haven't created a .md document yet, if the gdoc is ok we can transfer it to either the Wiki or something else easily (let me know in case what it is best). Luca On Fri, Feb 12, 2021 at 6:33 PM Evans Ye <[email protected]> wrote: > > Hey Luca, > > I read the comment. I'm really happy to see that you finally managed to get > it upgraded w/o missing blocks. Those are great lessons worth sharing. I > think we can do a polish on the google doc you created and then publish it to: > > 1. Bigtop ASF blog > 2. Bigtop confluence wiki > 3. Bigtop website > > Future: > - Conference sharing > > What do you think? > > > > Olaf Flebbe <[email protected]> 於 2021年2月13日 週六 上午1:07寫道： >> >> Hi Luca, >> >> this is so great ! I am really impressed by this achievement. >> Please create a MD out of it, we will surely find a place on the website for >> it. >> >> Best >> Olaf >> >> >> > Am 12.02.2021 um 09:52 schrieb Luca Toscano <[email protected]>: >> > >> > Hi everybody, >> > >> > We have finally migrated our CDH cluster to Bigtop 1.5, so I can say >> > that we are now happy Bigtop users :) >> > >> > The upgrade of the production cluster (60 worker nodes, ~50M files on >> > HDFS) was harder than I expected, since we bumped into a strange >> > performance issue that slowed down the HDFS upgrade. I wrote a summary >> > in https://phabricator.wikimedia.org/T273711#6818136 for whoever is >> > interested, it is surely something to highlight in the CDH->Bigtop >> > guide. Speaking of which, the last thing that we did was starting >> > https://docs.google.com/document/d/1fI1mvbR1mFLV6ohU5cIEnU5hFvEE7EWnKYWOkF55jtE/edit >> > some time ago, so I am wondering if we could find a more permanent >> > location. Would it make sense to start a wiki page somewhere? Or even >> > a .md file in the github repo, as you prefer (the latter would be more >> > convenient for reviewers etc..). >> > >> > Anyway, thanks a lot to all for the support! It was a looong project >> > but we eventually did it! >> > >> > Luca >>
