Re: [lustre-discuss] Robinhood scan time

2020-12-10 Thread Hervé Toureille
discuss" Envoyé: Mercredi 9 Décembre 2020 10:49:08 Objet: Re: [lustre-discuss] Robinhood scan time Hi Amit, we also faced very slow full scan performance before. As was mentioned before by Aurélien it is essential to investigate the processing stages within the Robinhood logs

Re: [lustre-discuss] Robinhood scan time

2020-12-08 Thread Degremont, Aurelien
hank you, Amit -Original Message- From: Stephane Thiell Sent: Monday, December 7, 2020 11:43 AM To: Degremont, Aurelien Cc: Kumar, Amit ; Russell Dekema ; lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] Robinhood scan time Hi Amit,

Re: [lustre-discuss] Robinhood scan time

2020-12-07 Thread Kumar, Amit
see if the benefits my scan times. Thank you, Amit -Original Message- From: Stephane Thiell Sent: Monday, December 7, 2020 11:43 AM To: Degremont, Aurelien Cc: Kumar, Amit ; Russell Dekema ; lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] Robinhood scan time Hi Amit, Your nu

Re: [lustre-discuss] Robinhood scan time

2020-12-07 Thread Stephane Thiell
nal Message- >From: Russell Dekema >Sent: Friday, December 4, 2020 4:27 PM > To: Kumar, Amit >Cc: lustre-discuss@lists.lustre.org >Subject: Re: [lustre-discuss] Robinhood scan time > >Greetings, > >What kind of hardware are you running o

Re: [lustre-discuss] Robinhood scan time

2020-12-07 Thread Degremont, Aurelien
regards, Amit -Original Message- From: Russell Dekema Sent: Friday, December 4, 2020 4:27 PM To: Kumar, Amit Cc: lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] Robinhood scan time Greetings, What kind of hardware are you running on your

Re: [lustre-discuss] Robinhood scan time

2020-12-04 Thread Kumar, Amit
-discuss] Robinhood scan time Greetings, What kind of hardware are you running on your metadata array? Cheers, Rusty Dekema On Fri, Dec 4, 2020 at 5:12 PM Kumar, Amit wrote: > > HI All, > > > > During LAD’20 Andreas mentioned if I could share the Robinhood scan time for > the

Re: [lustre-discuss] Robinhood scan time

2020-12-04 Thread Russell Dekema
Greetings, What kind of hardware are you running on your metadata array? Cheers, Rusty Dekema On Fri, Dec 4, 2020 at 5:12 PM Kumar, Amit wrote: > > HI All, > > > > During LAD’20 Andreas mentioned if I could share the Robinhood scan time for > the 369millions files we have. So here it is. It

[lustre-discuss] Robinhood scan time

2020-12-04 Thread Kumar, Amit
HI All, During LAD'20 Andreas mentioned if I could share the Robinhood scan time for the 369millions files we have. So here it is. It took ~23 days for me to complete initial scan of all 369 million files, on a dedicated robinhood server that has 384GB RAM. I had it setup with all tweaks for