Re: [lustre-discuss] Lustre and Optane
The most likely candidate for effectively using Optane/NVRAM would be via Persistent Client Cache (PCC), which allows client-local storage to be part of the Lustre namespace. Files can be cached on a local NVRAM device (managed by a local filesystem like ext4, or possibly something more experimental like NOVA for better performance) and then migrated into the cache. Once the file is in PCC, it can be accessed via the local filesystem operations, including DAX, for very low-latency operations. See the presentation from LAD'19 for details: https://www.eofs.eu/_media/events/lad19/07_li_xi-nvram_pcc.pdf It should be noted that in Lustre 2.13, files in PCC are NOT resident in the main filesystem, so if the client node goes offline then the files will not be accessible until the client node is restarted. For some workloads this is OK (e.g. files being generated locally with high IOPS that are occasionally needed on other clients), but not for others. We will be improving PCC to use FLR to mirror a copy into the client cache and still keep a copy in the main filesystem, but that is not available yet. Cheers, Andreas On Jan 13, 2020, at 10:03, Dave Holland mailto:d...@sanger.ac.uk>> wrote: I haven't been to LUG or LAD recently, so I'm a bit out of the loop, but how much use is Optane finding in the Lustre world? The main obstacle I see is that it's server-local, so building a resilient/failover-capable system isn't straightforward. Thanks for any observations. Cheers, Dave -- ** Dave Holland ** Systems Support -- Informatics Systems Group ** ** 01223 496923 **Wellcome Sanger Institute, Hinxton, UK** Cheers, Andreas -- Andreas Dilger Principal Lustre Architect Whamcloud ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] SC19 bof slides
Hi, That's what I was looking for, thank you! Regards Thomas Le 13 janvier 2020 18:23:08 GMT+01:00, "Rawlings, Kenrick D" a écrit : >Hi Thomas, > >An aggregated version of the slides is available at: > >http://lustre.org/wp-content/uploads/SC19LustreBoF_All.pdf > >There were some challenges combining them in a way that works in all >PDF viewers. If there are any issues with rendering, please let me know >and we can make the individual decks available as well. > >Thanks, >Ken > > > >Hello, > >Are the slides presented during the bof in Denver available somewhere? > >I'm specifically looking for one of the sites presentation that gave >some feedback about DoM. > >Regards > >Thomas Hamel -- Envoyé de mon appareil Android avec Courriel K-9 Mail. Veuillez excuser ma brièveté.___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] SC19 bof slides
Hi Thomas, An aggregated version of the slides is available at: http://lustre.org/wp-content/uploads/SC19LustreBoF_All.pdf There were some challenges combining them in a way that works in all PDF viewers. If there are any issues with rendering, please let me know and we can make the individual decks available as well. Thanks, Ken Hello, Are the slides presented during the bof in Denver available somewhere? I'm specifically looking for one of the sites presentation that gave some feedback about DoM. Regards Thomas Hamel ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre and Optane
I haven't been to LUG or LAD recently, so I'm a bit out of the loop, but how much use is Optane finding in the Lustre world? The main obstacle I see is that it's server-local, so building a resilient/failover-capable system isn't straightforward. Thanks for any observations. Cheers, Dave -- ** Dave Holland ** Systems Support -- Informatics Systems Group ** ** 01223 496923 **Wellcome Sanger Institute, Hinxton, UK** -- The Wellcome Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] SC19 bof slides
Hello, Are the slides presented during the bof in Denver available somewhere? I'm specifically looking for one of the sites presentation that gave some feedback about DoM. Regards Thomas Hamel ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
