I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao, feel free to cherry-pick this into the 3.2.2 release branch if you think it is relevant.
Also, can someone tell me which releases we should be targeting? Currently these versions are all Unreleased on JIRA: 3.4.1, 3.4.0 3.3.1, 3.3.0 3.2.3, 3.2.2 As far as I know, neither trunk nor 3.3 have a release going on. So I don't know why there are 2 versions as unreleased there. Eric On Mon, Dec 21, 2020 at 3:20 PM Jim Brennan <james.bren...@verizonmedia.com.invalid> wrote: > I put up a patch for > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10540&d=DwIFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=KVdP1SUmHYb-tZP8tcigmw&m=WEMl9mt9SZiq7P20DPgeZO69TFwf3d0eldQGRWlLyQg&s=FdkrkiWqHwuibT6qFqvApTkO5aTimLx7WeP74tka5XM&e= > . > Thanks for bringing it to my attention. > Jim > > On Mon, Dec 21, 2020 at 10:36 AM Sunil Govindan <sun...@apache.org> wrote: > > > I had some offline talks with a few folks. > > This issue is happening only in Mac, hence ideally it does not cause much > > of a problem in the supported OS. > > > > I will wait for feedback here to see whether we need another RC by fixing > > this. And will continue the discussion in the jira. > > > > Thanks > > Sunil > > > > On Sat, Dec 19, 2020 at 11:07 PM Sunil Govindan <sun...@apache.org> > wrote: > > > > > Thanks, Xiaoqiao. > > > All files are looking good. > > > > > > However, while I did the tests to verify the RC, I ran into a serious > NPE > > > in YARN. > > > I raised YARN-10540 < > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10540&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=8i-pN_j9VKNxmOzU6gYGtWm_IVyeZkBcMwVI2eyzpRk&e= > > > to > > > analyze this further. I think this issue due to YARN-10450 > > > < > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_YARN-2D10450&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=QEHMGtEbBz5Gn7mW4UsGlc-wNZ8ugZwiFQBy2pTx-Fw&e= > > >. > > > In the trunk, I am not able to see this issue. So It could be possible > > > that some patches are not backported to branch-3.2.2. > > > > > > UI1 & UI2 nodes page is not working at this moment. I will check a bit > > > more to see about this and update here. > > > > > > Thanks > > > Sunil > > > > > > On Sat, Dec 19, 2020 at 5:36 PM Xiaoqiao He <hexiaoq...@apache.org> > > wrote: > > > > > >> Thanks Sunil, md5 files have been removed from RC4. Please have a > look. > > >> Thanks & Regards. > > >> > > >> - He Xiaoqiao > > >> > > >> On Sat, Dec 19, 2020 at 7:22 PM Sunil Govindan <sun...@apache.org> > > wrote: > > >> > > >>> Hi Xiaoqiao, > > >>> > > >>> Please remove the md5 files from your shared RC4 repo. Thanks, @Akira > > >>> Ajisaka <aajis...@apache.org> for sharing this input. > > >>> > > >>> Thanks > > >>> Sunil > > >>> > > >>> On Sat, Dec 19, 2020 at 10:21 AM Sunil Govindan <sun...@apache.org> > > >>> wrote: > > >>> > > >>>> Reference: > > >>>> > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.apache.org_dev_release-2Ddistribution.html-23sigs-2Dand-2Dsums&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=0qrQgqFXZzLqTDPzH_T1emam7NnHvnzXqZ6Ag0ccgIQ&e= > > >>>> Also, we had a Jira to track this HADOOP-15930 > > >>>> < > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_HADOOP-2D15930&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=afUJEs9zxobnuEnC4v0xJ6v7d0dtrUkUaX15lI6VZbM&e= > > >. > > >>>> > > >>>> Thanks > > >>>> Sunil > > >>>> > > >>>> On Sat, Dec 19, 2020 at 10:16 AM Sunil Govindan <sun...@apache.org> > > >>>> wrote: > > >>>> > > >>>>> Hi Xiaoqiao and Wei-chiu > > >>>>> > > >>>>> I am a bit confused after seeing both *.sha512 and *.md5 files in > the > > >>>>> RC directory. > > >>>>> Are we releasing both now? > > >>>>> > > >>>>> Thanks > > >>>>> Sunil > > >>>>> > > >>>>> On Wed, Dec 9, 2020 at 10:32 PM Xiaoqiao He <hexiaoq...@apache.org > > > > >>>>> wrote: > > >>>>> > > >>>>>> Hi folks, > > >>>>>> > > >>>>>> The release candidate (RC4) for Hadoop-3.2.2 is available now. > > >>>>>> There are 10 commits[1] differences between RC4 and RC3[2]. > > >>>>>> > > >>>>>> The RC4 is available at: > > >>>>>> > > > https://urldefense.proofpoint.com/v2/url?u=http-3A__people.apache.org_-7Ehexiaoqiao_hadoop-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=HUI5h2vNLugUtOGnApsEXpk40-hQszUQyUNbfYRQeXU&e= > > >>>>>> The RC4 tag in github is here: > > >>>>>> > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_tree_release-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=Z3pv4v__QPeuKK5Ol_DOqKD-3deFnGKSfXdhi0v_K1c&e= > > >>>>>> The maven artifacts are staged at: > > >>>>>> > > >>>>>> > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__repository.apache.org_content_repositories_orgapachehadoop-2D1296&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=XA6ozoshoAKllmFj5vMTlXjE-8Ee41jaKYiTxBmnWpA&e= > > >>>>>> > > >>>>>> You can find my public key at: > > >>>>>> > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__dist.apache.org_repos_dist_release_hadoop_common_KEYS&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=oJ2jBABd8kCf9bLKre7vOkc4T010inenJNexdbGlOdg&e= > > or > > >>>>>> > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__people.apache.org_keys_committer_hexiaoqiao.asc&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=r5d-JXE1QGikxkDXlH-K9P15VaTM_kOtQz0IyBHM_Yk&e= > > directly. > > >>>>>> > > >>>>>> Please try the release and vote. > > >>>>>> > > >>>>>> I have done a simple testing with my pseudo cluster. > > >>>>>> * Verify gpg sign and md5sum. > > >>>>>> * Setup pseudo cluster with HDFS and YARN. > > >>>>>> * Run simple FsShell - mkdir/put/get/rename/mv. > > >>>>>> * Submit example mr job and check the result - Pi/wordcount. > > >>>>>> * Check the web UI of > NameNode/DataNode/Resourcemanager/NodeManager. > > >>>>>> My +1 to start. > > >>>>>> > > >>>>>> Thanks, > > >>>>>> He Xiaoqiao > > >>>>>> > > >>>>>> [1] > > >>>>>> > > >>>>>> > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_compare_release-2D3.2.2-2DRC3...release-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=uUm4bp4BGiN0L04RJ1ny8G0ugpng57O_0Im8zQfMMGc&e= > > >>>>>> [2] > > >>>>>> > > >>>>>> > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.apache.org_thread.html_rfb74c3a5d4f223c5804d8ee622829263740cd8701c8f3fc8b6f970af-2540-253Chdfs-2Ddev.hadoop.apache.org-253E&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=x0gXxcI_Gd1cGJRczQYxrTznWYSJcZqCkUHuUPUjL7w&e= > > >>>>>> [3] > > >>>>>> > > >>>>>> > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_secure_Dashboard.jspa-3FselectPageId-3D12335948&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=9w6gMkXXqF9gv5R3eFWF9fWH5mAJpqw7xXpGKd-XwfU&e= > > >>>>>> > > >>>>> > > >
