Re: [lustre-discuss] Is there aceiling of lustre filesystem a client can mount
Hi, Alastair & Mark Hahn Can mounted lustre filesystem(same version ) impact each other ? Can network become bottleneck? regards. ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Is there aceiling of lustre filesystem a client can mount
On Jul 15, 2020, at 8:39 PM, 肖正刚 wrote: > > Hi, Jongwoo & Andreas > > Sorry for the ambiguous description. > What I want to know is the number of lustre filesystems that a client can > mount on the same time. The number of filesystems a client can mount depends on how much RAM it has. I don't think anyone has done any measurement of this kind before, but there are several production sites that have 10 or more Lustre mounts on the client. Cheers, Andreas > > Message: 1 > Date: Wed, 15 Jul 2020 14:29:10 +0800 > From: ??? > To: lustre-discuss@lists.lustre.org > Subject: [lustre-discuss] Is there aceiling of lustre filesystem a > client can mount > > Hi, all > Is there a ceiling for a Lustre filesystem that can be mounted in a cluster? > If so, what's the number? > If not, how much is proper? > Does mount multiple filesystems can affect the stability of each file > system or cause other problems? > > Thanks! > > > Message: 3 > Date: Wed, 15 Jul 2020 23:45:57 +0900 > From: Jongwoo Han > To: ??? > Cc: lustre-discuss > Subject: Re: [lustre-discuss] Is there aceiling of lustre filesystem a > client can mount > > I think your question is ambiguous. > > What ceiling do you mean? Total storage capacity? number of disks? number > of clients? number of filesystems? > > Please be more clear about it. > > Regards, > Jongwoo Han > > 2020? 7? 15? (?) ?? 3:29, ??? ?? ??: > > > Hi, all > > Is there a ceiling for a Lustre filesystem that can be mounted in a > > cluster? > > If so, what's the number? > > If not, how much is proper? > > Does mount multiple filesystems can affect the stability of each file > > system or cause other problems? > Cheers, Andreas signature.asc Description: Message signed with OpenPGP ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Is there aceiling of lustre filesystem a client can mount
Hi, Mark Hahn Very appreciate for your detailed reply. And sorry for the ambiguous description. For some reasons, we decided not to expand on the lustre filesystem already exists; so what I want to know is the number of lustre filesystems that a client can mount on the same time . Best regards. Mark Hahn 于2020年7月16日周四 下午3:00写道： > > On Jul 15, 2020, at 12:29 AM, ??? wrote: > >> Is there a ceiling for a Lustre filesystem that can be mounted in a > cluster? > > It is very high, as Andreas said. > > >> If so, what's the number? > > The following contains specific limits: > > > https://build.whamcloud.com/job/lustre-manual//lastSuccessfulBuild/artifact/lustre_manual.xhtml#idm140436304680016 > > You'll notice that you must assume some aspects of configuration, such as > the > size and number of your OSTs. I see OSTs in the range of 75-400TB (and OST > counts between 58 and 187). > > >> If not, how much is proper? > > Lustre is designed to scale. So a config with a small number of OSTs, > on very few OSSes doesn't make that much sense. OSTs are pretty much > expected to be decent-sized RAIDs. There would be tradeoffs among cost- > efficient disk sizes (maybe 16T today) and RAID overhead (usually N+2), > and how that trades off with bandwidth (HBA and OSS network). > > >> Does mount multiple filesystems can affect the stability of each file > system or cause other problems? > > My experience is that the main factor in reliability is device count, > rather than how the devices are organized. For instance, if you > have more OSSes, you may get linearly nicer performance, but > you also increase your chance of having components crash or fail. > > The main reason for separate filesystems is usually that the MDS > (maybe MTD) can be a bottleneck. But you can scale MDSes, instead. > > regards, mark hahn. > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Is there aceiling of lustre filesystem a client can mount
On Jul 15, 2020, at 12:29 AM, ??? wrote: Is there a ceiling for a Lustre filesystem that can be mounted in a cluster? It is very high, as Andreas said. If so, what's the number? The following contains specific limits: https://build.whamcloud.com/job/lustre-manual//lastSuccessfulBuild/artifact/lustre_manual.xhtml#idm140436304680016 You'll notice that you must assume some aspects of configuration, such as the size and number of your OSTs. I see OSTs in the range of 75-400TB (and OST counts between 58 and 187). If not, how much is proper? Lustre is designed to scale. So a config with a small number of OSTs, on very few OSSes doesn't make that much sense. OSTs are pretty much expected to be decent-sized RAIDs. There would be tradeoffs among cost- efficient disk sizes (maybe 16T today) and RAID overhead (usually N+2), and how that trades off with bandwidth (HBA and OSS network). Does mount multiple filesystems can affect the stability of each file system or cause other problems? My experience is that the main factor in reliability is device count, rather than how the devices are organized. For instance, if you have more OSSes, you may get linearly nicer performance, but you also increase your chance of having components crash or fail. The main reason for separate filesystems is usually that the MDS (maybe MTD) can be a bottleneck. But you can scale MDSes, instead. regards, mark hahn. ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Is there aceiling of lustre filesystem a client can mount
Hi, Jongwoo & Andreas Sorry for the ambiguous description. What I want to know is the number of lustre filesystems that a client can mount on the same time. Thanks > > > Message: 1 > Date: Wed, 15 Jul 2020 14:29:10 +0800 > From: ??? > To: lustre-discuss@lists.lustre.org > Subject: [lustre-discuss] Is there aceiling of lustre filesystem a > client can mount > Message-ID: > hxr...@mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Hi, all > Is there a ceiling for a Lustre filesystem that can be mounted in a > cluster? > If so, what's the number? > If not, how much is proper? > Does mount multiple filesystems can affect the stability of each file > system or cause other problems? > > Thanks! > -- next part -- > An HTML attachment was scrubbed... > URL: < > http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20200715/e57d1c6f/attachment-0001.html > > > > -- > > > Message: 3 > Date: Wed, 15 Jul 2020 23:45:57 +0900 > From: Jongwoo Han > To: ??? > Cc: lustre-discuss > Subject: Re: [lustre-discuss] Is there aceiling of lustre filesystem a > client can mount > Message-ID: > kgfbw9qrommea3xscmy33l...@mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > I think your question is ambiguous. > > What ceiling do you mean? Total storage capacity? number of disks? number > of clients? number of filesystems? > > Please be more clear about it. > > Regards, > Jongwoo Han > > 2020? 7? 15? (?) ?? 3:29, ??? ?? ??: > > > Hi, all > > Is there a ceiling for a Lustre filesystem that can be mounted in a > > cluster? > > If so, what's the number? > > If not, how much is proper? > > Does mount multiple filesystems can affect the stability of each file > > system or cause other problems? > > > > Thanks! > > ___ > > lustre-discuss mailing list > > lustre-discuss@lists.lustre.org > > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > > > > > -- > Jongwoo Han > +82-505-227-6108 > -- next part -- > An HTML attachment was scrubbed... > URL: < > http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20200715/3329f03d/attachment-0001.html > > > > -- > > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Is there aceiling of lustre filesystem a client can mount
On Jul 15, 2020, at 12:29 AM, 肖正刚 wrote: > > Hi, all > Is there a ceiling for a Lustre filesystem that can be mounted in a cluster? > If so, what's the number? > If not, how much is proper? > Does mount multiple filesystems can affect the stability of each file system > or cause other problems? Depending on what limits you are looking for, you may find this link useful: https://build.whamcloud.com/job/lustre-manual//lastSuccessfulBuild/artifact/lustre_manual.xhtml#settinguplustresystem.tab2 For capacity and performance, the upper limits are probably "higher than what you have money for". :-) Cheers, Andreas signature.asc Description: Message signed with OpenPGP ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Is there aceiling of lustre filesystem a client can mount
I think your question is ambiguous. What ceiling do you mean? Total storage capacity? number of disks? number of clients? number of filesystems? Please be more clear about it. Regards, Jongwoo Han 2020년 7월 15일 (수) 오후 3:29, 肖正刚 님이 작성: > Hi, all > Is there a ceiling for a Lustre filesystem that can be mounted in a > cluster? > If so, what's the number? > If not, how much is proper? > Does mount multiple filesystems can affect the stability of each file > system or cause other problems? > > Thanks! > ___ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > -- Jongwoo Han +82-505-227-6108 ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Is there aceiling of lustre filesystem a client can mount
Hi, all Is there a ceiling for a Lustre filesystem that can be mounted in a cluster? If so, what's the number? If not, how much is proper? Does mount multiple filesystems can affect the stability of each file system or cause other problems? Thanks! ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
