Thanks Angerszhuuuu <angers....@gmail.com> ! I think we can start preparing the binaries Ethan Feng <ethan.aquarius....@gmail.com>
Thanks, Keyong Zhou angers zhu <angers....@gmail.com> 于2023年1月3日周二 11:18写道： > Hi all, > > I have checked the quick graceful shutdown and rolling restart worker. Fix > some minor problem and it's ok. > > Best Regards > Angerszhuuuu > > Keyong Zhou <zho...@apache.org> 于2022年12月21日周三 11:39写道： > > > Thank you guys for the valuable tests! > > > > angers zhu <angers....@gmail.com> 于2022年12月21日周三 10:33写道： > > > > > Hi all, > > > > > > I have tested quota management and make some minor improvements. It can > > > work well. > > > later I will test worker quick restart. > > > > > > apache <ethanf...@apache.org> 于2022年12月21日周三 10:00写道： > > > > > >> Hi community: > > >> I’ve tested branch-0.2 about load-aware slots allocation modules with > a > > >> fusion cluster of HDDs, SSDs, and ESSDs. As expected, workers with > > faster > > >> disk drives have more slots on them. > > >> > > >> The way I tested is as follows: > > >> I ran 1T TPC-DS while 1TB Terasort was running repeatedly and tested > > >> different parameter combinations on three node groups. The group core > > has > > >> 10x NVME SSD drives. Group task 1 has 4x ESSD drives. Group task 2 has > > 12x > > >> SATA HDD drivers. > > >> > > >> Here are some snapshots: > > >> > > >> Graph 1: Only NVME SSD and HDD workers are involved and > > >> "celeborn.slots.assign.loadAware.numDiskGroups" is set to 2. > > >> > > >> > > >> Graph 2: All nodes are involved and > > >> "celeborn.slots.assign.loadAware.numDiskGroups" is set to 3. > > >> > > >> > > >> Thanks, > > >> Ethan Feng > > >> 在 2022年12月14日 +0800 19:41，Keyong Zhou <zho...@apache.org>，写道： > > >> > > >> Hi celeborn (-incubating) community: > > >> > > >> Currently we are preparing for the first release (branch-0.2). To > ensure > > >> code quality, I would like to test for core-path correctness and > > >> stability, > > >> could Angerszhuuuu <angers....@gmail.com> and nafiyaix > > >> <nafiyai...@gmail.com> help test graceful shutdown and rolling > upgrade? > > >> And > > >> could Ethan Feng <ethan.aquarius....@gmail.com> help test load-aware > > >> slots > > >> allocation? > > >> > > >> And we would be rather happy if anyone can help test for other modules > > >> (k8s, HA, etc.). > > >> > > >> Thanks, > > >> Keyong > > >> > > >> > > >
