Re: [oi-dev] How many CPUs does OI support?
> On 8. Jan 2021, at 09:53, Chris wrote: > > I'm looking to help building packages. Both current, as > well as newer versions. I have a large server farm. But > primarily BSD based. As such I'm looking into a new build > box, based on an Opteron or Xeon. So before I take the > plunge. I was hoping to add as many CPU/cores as possible. > Which begs the question: haw many CPUs does OI support? > > Thank you for all your time, and consideration. > > —Chris > well, ncpu is signed int… ;) rgds, toomas ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev
Re: [oi-dev] How many CPUs does OI support?
On Thu, 7 Jan 2021 at 23:53, Chris wrote: > I'm looking to help building packages. Both current, as > well as newer versions. I have a large server farm. But > primarily BSD based. As such I'm looking into a new build > box, based on an Opteron or Xeon. So before I take the > plunge. I was hoping to add as many CPU/cores as possible. > Which begs the question: haw many CPUs does OI support? I don't think you'll be able to buy a machine with more CPUs than we support in illumos. I've personally used older HP machines with 4 CPU sockets and thus a lot of cores, and modern AMD systems which have a still surprising number of cores in one or two packages. In the unlikely event that you hit a problem based on core count, I am sure it will just be a bug that can be fixed. Cheers. -- Joshua M. Clulow http://blog.sysmgr.org ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev
Re: [oi-dev] How many CPUs does OI support?
Hey Chris Considering we are coming from the SPARC side which lately went beyond a thousand cores, I have never heard of us having a limit. And Joyent had some beasts of Xeon's with smartOS which we simply ride along for support as illumos-gate has those patches IIRC. If you are using OLD KVM Vm's before 1.3 you will need to specify sockets instead of cores, due to a bug, but otherwise you are good. And if there is a limit I think that classifies as bug! So I support upstreaming a fix to get that sorted. -Till On 08.01.21 04:53, Chris wrote: I'm looking to help building packages. Both current, as well as newer versions. I have a large server farm. But primarily BSD based. As such I'm looking into a new build box, based on an Opteron or Xeon. So before I take the plunge. I was hoping to add as many CPU/cores as possible. Which begs the question: haw many CPUs does OI support? Thank you for all your time, and consideration. --Chris ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev
Re: [oi-dev] How many CPUs does OI support?
On 08.01.21 08:53, Chris wrote: ... Which begs the question: haw many CPUs does OI support? Apart from the theoretical limit, what is practically usable could, of course, be different. For a lower limit: We run a Fujitsu RX900 S2 with 80 cores for nearly a decade now, no problems at all. So there seems to be plenty of headroom left... smime.p7s Description: S/MIME Cryptographic Signature ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev
Re: [oi-dev] How many CPUs does OI support?
On 2021-01-08 01:17, Joshua M. Clulow via oi-dev wrote: On Thu, 7 Jan 2021 at 23:53, Chris wrote: I'm looking to help building packages. Both current, as well as newer versions. I have a large server farm. But primarily BSD based. As such I'm looking into a new build box, based on an Opteron or Xeon. So before I take the plunge. I was hoping to add as many CPU/cores as possible. Which begs the question: haw many CPUs does OI support? I don't think you'll be able to buy a machine with more CPUs than we support in illumos. I've personally used older HP machines with 4 CPU sockets and thus a lot of cores, and modern AMD systems which have a still surprising number of cores in one or two packages. In the unlikely event that you hit a problem based on core count, I am sure it will just be a bug that can be fixed. OK so 4 sockets @16 cores/ea, or 2 sockets @64 cores/ea won't be a problem then. Thanks for the reply! :-) Time to go shopping. --Chris Cheers. -- ~40yrs of UNIX and counting ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev
Re: [oi-dev] How many CPUs does OI support?
Am 08.01.21 um 17:15 schrieb Chris: On 2021-01-08 01:17, Joshua M. Clulow via oi-dev wrote: On Thu, 7 Jan 2021 at 23:53, Chris wrote: I'm looking to help building packages. Both current, as well as newer versions. I have a large server farm. But primarily BSD based. As such I'm looking into a new build box, based on an Opteron or Xeon. So before I take the plunge. I was hoping to add as many CPU/cores as possible. Which begs the question: haw many CPUs does OI support? I don't think you'll be able to buy a machine with more CPUs than we support in illumos. I've personally used older HP machines with 4 CPU sockets and thus a lot of cores, and modern AMD systems which have a still surprising number of cores in one or two packages. In the unlikely event that you hit a problem based on core count, I am sure it will just be a bug that can be fixed. OK so 4 sockets @16 cores/ea, or 2 sockets @64 cores/ea won't be a problem then. Thanks for the reply! :-) Time to go shopping. --Chris Cheers. Tell us when your server exceeds 384 Cores / 3072 Threads. AFAIK that's what actual Fujitsu/Oracle M12 provide at max. :D ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev
Re: [oi-dev] How many CPUs does OI support?
On 2021-01-08 08:39, Andreas Wacknitz wrote: Am 08.01.21 um 17:15 schrieb Chris: On 2021-01-08 01:17, Joshua M. Clulow via oi-dev wrote: On Thu, 7 Jan 2021 at 23:53, Chris wrote: I'm looking to help building packages. Both current, as well as newer versions. I have a large server farm. But primarily BSD based. As such I'm looking into a new build box, based on an Opteron or Xeon. So before I take the plunge. I was hoping to add as many CPU/cores as possible. Which begs the question: haw many CPUs does OI support? I don't think you'll be able to buy a machine with more CPUs than we support in illumos. I've personally used older HP machines with 4 CPU sockets and thus a lot of cores, and modern AMD systems which have a still surprising number of cores in one or two packages. In the unlikely event that you hit a problem based on core count, I am sure it will just be a bug that can be fixed. OK so 4 sockets @16 cores/ea, or 2 sockets @64 cores/ea won't be a problem then. Thanks for the reply! :-) Time to go shopping. --Chris Cheers. Tell us when your server exceeds 384 Cores / 3072 Threads. AFAIK that's what actual Fujitsu/Oracle M12 provide at max. :D Sweet! :-) TBH the only reason I brought it up was that we had a similar question on one of the FreeBSD lists. Where they had difficulty exceeding 96 on a 128. I've forgotten whether it turned out to be config of (actual) limitation. Mind you that was BSD. But given the shared heritage, it seemed an appropriate question. Thanks for the stats. Maybe I should give Fujitsu a look. :-) --Chris ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev -- ~40yrs of UNIX and counting ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev
Re: [oi-dev] How many CPUs does OI support?
I seem to recall reading in a book cerca Solaris 10 about the kernel internals that it supported UNSIGNED SMALL INT (about 65k) cores but I am having a hard time finding anything to back that up and I gave that book away in a donation pile many years ago so I can't double check easily. I know my loose recollection isn't that helpful but it jives with the other folks suggesting that the limit is way higher than BSD :) On Fri, Jan 8, 2021 at 12:01 PM Chris wrote: > On 2021-01-08 08:39, Andreas Wacknitz wrote: > > Am 08.01.21 um 17:15 schrieb Chris: > >> On 2021-01-08 01:17, Joshua M. Clulow via oi-dev wrote: > >>> On Thu, 7 Jan 2021 at 23:53, Chris wrote: > I'm looking to help building packages. Both current, as > well as newer versions. I have a large server farm. But > primarily BSD based. As such I'm looking into a new build > box, based on an Opteron or Xeon. So before I take the > plunge. I was hoping to add as many CPU/cores as possible. > Which begs the question: haw many CPUs does OI support? > >>> > >>> I don't think you'll be able to buy a machine with more CPUs than we > >>> support in illumos. I've personally used older HP machines with 4 CPU > >>> sockets and thus a lot of cores, and modern AMD systems which have a > >>> still surprising number of cores in one or two packages. > >>> > >>> In the unlikely event that you hit a problem based on core count, I am > >>> sure it will just be a bug that can be fixed. > >> OK so 4 sockets @16 cores/ea, or 2 sockets @64 cores/ea won't be a > >> problem then. > >> Thanks for the reply! :-) > >> Time to go shopping. > >> > >> > >> --Chris > >>> > >>> > >>> Cheers. > >> > > Tell us when your server exceeds 384 Cores / 3072 Threads. AFAIK that's > > what actual Fujitsu/Oracle M12 provide at max. :D > Sweet! :-) > TBH the only reason I brought it up was that we had a similar question on > one of the FreeBSD lists. Where they had difficulty exceeding 96 on a 128. > I've forgotten whether it turned out to be config of (actual) limitation. > Mind you that was BSD. But given the shared heritage, it seemed an > appropriate question. > Thanks for the stats. Maybe I should give Fujitsu a look. :-) > > --Chris > > > > > > ___ > > oi-dev mailing list > > oi-dev@openindiana.org > > https://openindiana.org/mailman/listinfo/oi-dev > > -- > ~40yrs of UNIX and counting > > ___ > oi-dev mailing list > oi-dev@openindiana.org > https://openindiana.org/mailman/listinfo/oi-dev > ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev
Re: [oi-dev] How many CPUs does OI support?
Hello, Technically, there are only soft limits. I remember something like 256 cores x 14-16 threads/core for OI x64-based systems. SPARC was around 512 cores.Higher thread count was around 4096 threads. A true beast... ~K On Thursday, January 7, 2021, 11:53:11 PM PST, Chris wrote: I'm looking to help building packages. Both current, as well as newer versions. I have a large server farm. But primarily BSD based. As such I'm looking into a new build box, based on an Opteron or Xeon. So before I take the plunge. I was hoping to add as many CPU/cores as possible. Which begs the question: haw many CPUs does OI support? Thank you for all your time, and consideration. --Chris -- ~40yrs of UNIX and counting ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev
Re: [oi-dev] How many CPUs does OI support?
On Fri, 8 Jan 2021, Chris wrote: TBH the only reason I brought it up was that we had a similar question on one of the FreeBSD lists. Where they had difficulty exceeding 96 on a 128. I've forgotten whether it turned out to be config of (actual) limitation. Mind you that was BSD. But given the shared heritage, it seemed an appropriate question. A shared heritage of SunOS BSD-derived code ported into a System V base (and first released to the world as 'Solaris' in 1992) does not seem very applicable after so many years. Sun did massive work to be able to scale on large systems. Bob -- Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ Public Key, http://www.simplesystems.org/users/bfriesen/public-key.txt ___ oi-dev mailing list oi-dev@openindiana.org https://openindiana.org/mailman/listinfo/oi-dev