I put up a patch for https://issues.apache.org/jira/browse/YARN-10540. Thanks for bringing it to my attention. Jim
On Mon, Dec 21, 2020 at 10:36 AM Sunil Govindan <sun...@apache.org> wrote: > I had some offline talks with a few folks. > This issue is happening only in Mac, hence ideally it does not cause much > of a problem in the supported OS. > > I will wait for feedback here to see whether we need another RC by fixing > this. And will continue the discussion in the jira. > > Thanks > Sunil > > On Sat, Dec 19, 2020 at 11:07 PM Sunil Govindan <sun...@apache.org> wrote: > > > Thanks, Xiaoqiao. > > All files are looking good. > > > > However, while I did the tests to verify the RC, I ran into a serious NPE > > in YARN. > > I raised YARN-10540 < > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10540&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=8i-pN_j9VKNxmOzU6gYGtWm_IVyeZkBcMwVI2eyzpRk&e= > > to > > analyze this further. I think this issue due to YARN-10450 > > < > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10450&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=QEHMGtEbBz5Gn7mW4UsGlc-wNZ8ugZwiFQBy2pTx-Fw&e= > >. > > In the trunk, I am not able to see this issue. So It could be possible > > that some patches are not backported to branch-3.2.2. > > > > UI1 & UI2 nodes page is not working at this moment. I will check a bit > > more to see about this and update here. > > > > Thanks > > Sunil > > > > On Sat, Dec 19, 2020 at 5:36 PM Xiaoqiao He <hexiaoq...@apache.org> > wrote: > > > >> Thanks Sunil, md5 files have been removed from RC4. Please have a look. > >> Thanks & Regards. > >> > >> - He Xiaoqiao > >> > >> On Sat, Dec 19, 2020 at 7:22 PM Sunil Govindan <sun...@apache.org> > wrote: > >> > >>> Hi Xiaoqiao, > >>> > >>> Please remove the md5 files from your shared RC4 repo. Thanks, @Akira > >>> Ajisaka <aajis...@apache.org> for sharing this input. > >>> > >>> Thanks > >>> Sunil > >>> > >>> On Sat, Dec 19, 2020 at 10:21 AM Sunil Govindan <sun...@apache.org> > >>> wrote: > >>> > >>>> Reference: > >>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.apache.org_dev_release-2Ddistribution.html-23sigs-2Dand-2Dsums&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=0qrQgqFXZzLqTDPzH_T1emam7NnHvnzXqZ6Ag0ccgIQ&e= > >>>> Also, we had a Jira to track this HADOOP-15930 > >>>> < > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_HADOOP-2D15930&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=afUJEs9zxobnuEnC4v0xJ6v7d0dtrUkUaX15lI6VZbM&e= > >. > >>>> > >>>> Thanks > >>>> Sunil > >>>> > >>>> On Sat, Dec 19, 2020 at 10:16 AM Sunil Govindan <sun...@apache.org> > >>>> wrote: > >>>> > >>>>> Hi Xiaoqiao and Wei-chiu > >>>>> > >>>>> I am a bit confused after seeing both *.sha512 and *.md5 files in the > >>>>> RC directory. > >>>>> Are we releasing both now? > >>>>> > >>>>> Thanks > >>>>> Sunil > >>>>> > >>>>> On Wed, Dec 9, 2020 at 10:32 PM Xiaoqiao He <hexiaoq...@apache.org> > >>>>> wrote: > >>>>> > >>>>>> Hi folks, > >>>>>> > >>>>>> The release candidate (RC4) for Hadoop-3.2.2 is available now. > >>>>>> There are 10 commits[1] differences between RC4 and RC3[2]. > >>>>>> > >>>>>> The RC4 is available at: > >>>>>> > https://urldefense.proofpoint.com/v2/url?u=http-3A__people.apache.org_-7Ehexiaoqiao_hadoop-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=HUI5h2vNLugUtOGnApsEXpk40-hQszUQyUNbfYRQeXU&e= > >>>>>> The RC4 tag in github is here: > >>>>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_tree_release-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=Z3pv4v__QPeuKK5Ol_DOqKD-3deFnGKSfXdhi0v_K1c&e= > >>>>>> The maven artifacts are staged at: > >>>>>> > >>>>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__repository.apache.org_content_repositories_orgapachehadoop-2D1296&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=XA6ozoshoAKllmFj5vMTlXjE-8Ee41jaKYiTxBmnWpA&e= > >>>>>> > >>>>>> You can find my public key at: > >>>>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__dist.apache.org_repos_dist_release_hadoop_common_KEYS&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=oJ2jBABd8kCf9bLKre7vOkc4T010inenJNexdbGlOdg&e= > or > >>>>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__people.apache.org_keys_committer_hexiaoqiao.asc&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=r5d-JXE1QGikxkDXlH-K9P15VaTM_kOtQz0IyBHM_Yk&e= > directly. > >>>>>> > >>>>>> Please try the release and vote. > >>>>>> > >>>>>> I have done a simple testing with my pseudo cluster. > >>>>>> * Verify gpg sign and md5sum. > >>>>>> * Setup pseudo cluster with HDFS and YARN. > >>>>>> * Run simple FsShell - mkdir/put/get/rename/mv. > >>>>>> * Submit example mr job and check the result - Pi/wordcount. > >>>>>> * Check the web UI of NameNode/DataNode/Resourcemanager/NodeManager. > >>>>>> My +1 to start. > >>>>>> > >>>>>> Thanks, > >>>>>> He Xiaoqiao > >>>>>> > >>>>>> [1] > >>>>>> > >>>>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_compare_release-2D3.2.2-2DRC3...release-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=uUm4bp4BGiN0L04RJ1ny8G0ugpng57O_0Im8zQfMMGc&e= > >>>>>> [2] > >>>>>> > >>>>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.apache.org_thread.html_rfb74c3a5d4f223c5804d8ee622829263740cd8701c8f3fc8b6f970af-2540-253Chdfs-2Ddev.hadoop.apache.org-253E&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=x0gXxcI_Gd1cGJRczQYxrTznWYSJcZqCkUHuUPUjL7w&e= > >>>>>> [3] > >>>>>> > >>>>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_secure_Dashboard.jspa-3FselectPageId-3D12335948&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=9w6gMkXXqF9gv5R3eFWF9fWH5mAJpqw7xXpGKd-XwfU&e= > >>>>>> > >>>>> >