Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Hugepages are now supported, with Oracle 11.2.0.2.0 released yesterday Cheers Damian -Original Message- From: Linux on 390 Port [mailto:LINUX-390@VM.MARIST.EDU] On Behalf Of Szefler Jakub - Hurt TP Sent: 27 November 2009 16:34 To: LINUX-390@VM.MARIST.EDU Subject: Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 You can't use it. I tried to configure hugepages with oracle but oracle never saw hugepages. After started oracle database we always got : HugePages_Total: 1024 HugePages_Free: 1024 HugePages_Rsvd: 0 Hugepagesize: 2048 kB We recived notice from oracle support - 361323.1. You can see that for IBM zSeries Based Linux s390 (for kernel 2.4 and for 2.6) hugepages N/A. Notice describe oracle 9 but we got informations that is valid for oracle 10.2 too. -Original Message- From: Linux on 390 Port [mailto:LINUX-390@VM.MARIST.EDU] On Behalf Of Thomas Kern Sent: Friday, November 27, 2009 4:15 PM To: LINUX-390@VM.MARIST.EDU Subject: Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 Not for sale or not supported? /Tom Kern Szefler Jakub - Hurt TP wrote: > Hi, > > I have official answer from oracle that oracle database not available > for zlinux :(. > > > Jakub Szefler > Administrator Mainframe > > Pion Operacji IT Grupy TP/Departament Infrastruktury Wydział > Infrastruktury Informatycznej Dział Platform Serwerowych i Pamięci > Masowych -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For more information on Linux on System z, visit http://wiki.linuxvm.org/
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
On Sat, 28 Nov 2009 07:26:15 -0800 Barton Robinson wrote: > Martin, please correct me if i am wrong. > Large page support supports 1mb pages - meaning consecutive 256 4k pages > in hardware. These pages are "fixed", are not pageable with current > technology. The advantage is that there is one TLB entry per megabyte > instead of one per 4k page, so that the TLB is more efficient and more > entries fit into the hardware cache, requiring less DAT translations. > To get advantage then, there would have to be 1mb of very active > programs or data packaged in that 1mb page. Operating systems could be > packaged for this with work. zTPF took advantage of this, but that > architecture is focused on performance, not virtualization. Technically large pages could be swapped, the invalid bit in the segment table entry is there. Linux does not do this because it would be complicated and not very effective because of the packing of data you mentioned. The main use case for large pages are large in-memory databases. > For oracle, it would require dedicating 256 consecutive hardware pages > to an oracle database, running virtual under linux, running virtual > under z/vm - yep, quite a challenge. In a virtual environment where we > do run many different programs - the benefit to programs and data would > be difficult to show. The pages that are dedicated to the large pages in the guest can be swapped by z/VM without a problem. You could argue that these large pages are not really large pages because of the software emulation via shared page table pages but you do get the savings in the page table memory which is ihmo well worth the effort. > The benefits of large pages are to those places that can and do measure > differences in performance at the single digit percentage difference > (zTPF). z/VM could get a little advantage with a lot of work, linux in > an LPAR as well. Linux under z/VM not. I would be surprised if the > improvement was measurable in any truly virtualized environment. There will be considerable improvement if the oracle workload uses i) many processes and ii) large shared segments. For each process that maps 1GB of shared memory you save 2MB in page tables. -- blue skies, Martin. "Reality continues to ruin my life." - Calvin. -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Martin, please correct me if i am wrong. Large page support supports 1mb pages - meaning consecutive 256 4k pages in hardware. These pages are "fixed", are not pageable with current technology. The advantage is that there is one TLB entry per megabyte instead of one per 4k page, so that the TLB is more efficient and more entries fit into the hardware cache, requiring less DAT translations. To get advantage then, there would have to be 1mb of very active programs or data packaged in that 1mb page. Operating systems could be packaged for this with work. zTPF took advantage of this, but that architecture is focused on performance, not virtualization. For oracle, it would require dedicating 256 consecutive hardware pages to an oracle database, running virtual under linux, running virtual under z/vm - yep, quite a challenge. In a virtual environment where we do run many different programs - the benefit to programs and data would be difficult to show. The benefits of large pages are to those places that can and do measure differences in performance at the single digit percentage difference (zTPF). z/VM could get a little advantage with a lot of work, linux in an LPAR as well. Linux under z/VM not. I would be surprised if the improvement was measurable in any truly virtualized environment. Martin Schwidefsky wrote: On Sat, 28 Nov 2009 12:07:16 +1000 Shane wrote: I missed the earlier part of this thread, but is large page support even in z/VM ?. Alan ?. I have a recollection that Mario Held from the Boeblingen labs said this has been tested, but only for an LPAR install. And I'm pretty sure I followed up on this and got the answer it's not even in V6.1. Happy to be proved wrong. Large page support is not available in z/VM, in particular guest support is pretty hard to do. But the nice thing is: you don't need guest support to reap the main benefit of large pages. There are two benefits: 1) Less TLB entries for the same amount of addressed shared memory. 2) Reduced memory overhead for the page tables to map the shared memory. You get TLB saving only on LPAR with the hardware support but you can get the page table savings on z/VM with a little trick. Allocate huge pages like you do if you have the hardware support. Then in addition allocate a page table page to map the huge page and associate it with the huge page. When the huge page is mapped to a process use the same page table for all mappers. Sort of a poor man page table sharing. This trick works on z/VM and on older machines that do not even have large pages. On non-s390 one of the big plusses is avoiding TLB misses. But given that I believe z/VM also doesn't support hiperdispatch, that may not be much of a gain on zSeries either. I don't see the connection between TLB misses and hiperdispatch. Could you elaborate please? -- blue skies, Martin. "Reality continues to ruin my life." - Calvin. -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
On Sat, 2009-11-28 at 09:43 +0100, Martin Schwidefsky wrote: > I don't see the connection between TLB misses and hiperdispatch. Could > you elaborate please? I (perhaps naively) believed that an operating system that had the ability to request PR/SM only dispatch it on a CPU that was cache (and TLB) "hot" might actually generate some benefit. The z/OS developers seemed to think so. Are you suggesting that running as a guest under z/VM on PR/SM arbitrated hardware would *not* benefit from this ?. How about being dispatched on an entirely different book (node from a NUMA perspective) if the guest made the effort to ensure dispatch was "close" to the last CPU used. I would think that having a hipervisor in between that lies to its guest(s) can hardly be beneficial. Maybe I'm just being too simplistic. Shane ... -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
On Sat, 28 Nov 2009 12:07:16 +1000 Shane wrote: > I missed the earlier part of this thread, but is large page support even > in z/VM ?. Alan ?. > I have a recollection that Mario Held from the Boeblingen labs said this > has been tested, but only for an LPAR install. And I'm pretty sure I > followed up on this and got the answer it's not even in V6.1. > Happy to be proved wrong. Large page support is not available in z/VM, in particular guest support is pretty hard to do. But the nice thing is: you don't need guest support to reap the main benefit of large pages. There are two benefits: 1) Less TLB entries for the same amount of addressed shared memory. 2) Reduced memory overhead for the page tables to map the shared memory. You get TLB saving only on LPAR with the hardware support but you can get the page table savings on z/VM with a little trick. Allocate huge pages like you do if you have the hardware support. Then in addition allocate a page table page to map the huge page and associate it with the huge page. When the huge page is mapped to a process use the same page table for all mappers. Sort of a poor man page table sharing. This trick works on z/VM and on older machines that do not even have large pages. > On non-s390 one of the big plusses is avoiding TLB misses. But given > that I believe z/VM also doesn't support hiperdispatch, that may not be > much of a gain on zSeries either. I don't see the connection between TLB misses and hiperdispatch. Could you elaborate please? -- blue skies, Martin. "Reality continues to ruin my life." - Calvin. -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Hugepages+oracle 10.0.2.0.4 in sles10sp2
I'm having trouble seeing (my) replies from my work account, so this is a workround. Oracle database is fully supported, certified etc on Linux on IBM zSeries, both native and under VM. Full stop. Period. End of story. I'm looking into the hugepage issue , as the last time we reviewed the generic doc on Metalink it wasn't in the kernel. Film at 11. cheers Damian (@Oracle Support) -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
I missed the earlier part of this thread, but is large page support even in z/VM ?. Alan ?. I have a recollection that Mario Held from the Boeblingen labs said this has been tested, but only for an LPAR install. And I'm pretty sure I followed up on this and got the answer it's not even in V6.1. Happy to be proved wrong. On non-s390 one of the big plusses is avoiding TLB misses. But given that I believe z/VM also doesn't support hiperdispatch, that may not be much of a gain on zSeries either. Shane ... On Fri, 2009-11-27 at 17:03 -0700, Mark Post wrote: > >>> On 11/27/2009 at 6:12 PM, Barton Robinson wrote: > > Having seen a very good performance presentation from IBM on the > > value of huge pages, I'm interested in knowing what value y'all > > expect from this? > > For me, just a big savings in page table overhead for relatively large > Oracle systems with lots and lots of processes mapping a lot of shared > memory. -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
>>> On 11/27/2009 at 6:12 PM, Barton Robinson >>> wrote: > Having seen a very good performance presentation from IBM on the value > of huge pages, I'm interested in knowing what value y'all expect from this? For me, just a big savings in page table overhead for relatively large Oracle systems with lots and lots of processes mapping a lot of shared memory. Mark Post -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Having seen a very good performance presentation from IBM on the value of huge pages, I'm interested in knowing what value y'all expect from this? Mark Post wrote: On 11/27/2009 at 12:36 PM, Szefler Jakub - Hurt TP wrote: Yes :) It may be poorly understood. I forgot unfortunately "oracle database with hugepages" not available for zlinux for now. It should be supported. As Damian Gallagher said in his reply, the problem wasn't that Oracle couldn't/wouldn't use hugepages on Linux for System z. The problem was that the support for them wasn't in the Linux for System z kernel until recently. Now that it is, it should work and be supported. If it is not working, you should open up a problem report with your support provider. Mark Post -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
>>> On 11/27/2009 at 12:36 PM, Szefler Jakub - Hurt TP wrote: > Yes :) It may be poorly understood. > I forgot unfortunately "oracle database with hugepages" not available for > zlinux for now. It should be supported. As Damian Gallagher said in his reply, the problem wasn't that Oracle couldn't/wouldn't use hugepages on Linux for System z. The problem was that the support for them wasn't in the Linux for System z kernel until recently. Now that it is, it should work and be supported. If it is not working, you should open up a problem report with your support provider. Mark Post -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Yes :) It may be poorly understood. I forgot unfortunately "oracle database with hugepages" not available for zlinux for now. Of course oracle database if fully supported on zlinux. We using several oracle databases. Jakub Szefler Administrator Mainframe -Original Message- From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of David Boyes Sent: Friday, November 27, 2009 6:21 PM To: LINUX-390@VM.MARIST.EDU Subject: Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 On 11/27/09 5:34 AM, "Szefler Jakub - Hurt TP" wrote: > Hi, > > I have official answer from oracle that oracle database not available > for zlinux :(. That answer is just wrong. Oracle is certainly available for zLinux. Many of the Oracle *apps* are not available, but the database certainly is. To the original question, it doesn't appear that Oracle takes advantage of the hugepage support yet on this platform. -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
On 11/27/09 5:34 AM, "Szefler Jakub - Hurt TP" wrote: > Hi, > > I have official answer from oracle that oracle database not available for > zlinux :(. That answer is just wrong. Oracle is certainly available for zLinux. Many of the Oracle *apps* are not available, but the database certainly is. To the original question, it doesn't appear that Oracle takes advantage of the hugepage support yet on this platform. -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
You can't use it. I tried to configure hugepages with oracle but oracle never saw hugepages. After started oracle database we always got : HugePages_Total: 1024 HugePages_Free: 1024 HugePages_Rsvd: 0 Hugepagesize: 2048 kB We recived notice from oracle support - 361323.1. You can see that for IBM zSeries Based Linux s390 (for kernel 2.4 and for 2.6) hugepages N/A. Notice describe oracle 9 but we got informations that is valid for oracle 10.2 too. -Original Message- From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of Thomas Kern Sent: Friday, November 27, 2009 4:15 PM To: LINUX-390@VM.MARIST.EDU Subject: Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 Not for sale or not supported? /Tom Kern Szefler Jakub - Hurt TP wrote: > Hi, > > I have official answer from oracle that oracle database not available > for zlinux :(. > > > Jakub Szefler > Administrator Mainframe > > Pion Operacji IT Grupy TP/Departament Infrastruktury Wydział > Infrastruktury Informatycznej Dział Platform Serwerowych i Pamięci > Masowych -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Not for sale or not supported? /Tom Kern Szefler Jakub - Hurt TP wrote: > Hi, > > I have official answer from oracle that oracle database not available for > zlinux :(. > > > Jakub Szefler > Administrator Mainframe > > Pion Operacji IT Grupy TP/Departament Infrastruktury > Wydział Infrastruktury Informatycznej > Dział Platform Serwerowych i Pamięci Masowych -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
I can certainly state that it's most definitely available, as it's running for an awful lot of customers :-) I'll chase down that response - contact me off list with the precise details, please. I'm currently investigating the status of this - the last time the docs were updated support for hugepages wasn't in the kernel - now that it is I'll get this revised. Back soon Damian -Original Message- From: Linux on 390 Port [mailto:linux-...@vm.marist.edu]on Behalf Of Szefler Jakub - Hurt TP Sent: 27 November 2009 10:34 To: LINUX-390@VM.MARIST.EDU Subject: Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 Hi, I have official answer from oracle that oracle database not available for zlinux :(. Jakub Szefler Administrator Mainframe Pion Operacji IT Grupy TP/Departament Infrastruktury Wydział Infrastruktury Informatycznej Dział Platform Serwerowych i Pamięci Masowych ul. Goplańska 25, 91-463 Łódź tel.0 42 655 32 29 fax.0 42 655 42 22 Telekomunikacja Polska <<http://www.tp.pl>> Telekomunikacja Polska Spółka Akcyjna z siedzibą i adresem w Warszawie (00-105) przy ulicy Twardej 18, wpisana do Rejestru Przedsiębiorców prowadzonego przez Sąd Rejonowy dla m.st.Warszawy XII Wydział Gospodarczy Krajowego Rejestru Sądowego pod numerem 010681; REGON 012100784, NIP 526-02-50-995; z pokrytym w całości kapitałem zakładowym wynoszącym 4 106 319 723 zł __ Treść tej wiadomości zawiera informacje przeznaczone tylko dla adresata. Jeżeli nie jesteście Państwo jej adresatem, bądź otrzymaliście ją przez pomyłkę, prosimy o powiadomienie o tym nadawcy oraz trwałe jej usunięcie. -Original Message- From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of Gerald Schaefer Sent: Tuesday, November 17, 2009 2:54 PM To: LINUX-390@VM.MARIST.EDU Subject: Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 Hi, I am not aware of any specific studies, but the page table sharing benefit was explained in some detail in a z/Journal article: http://zjournal.tcipubs.com/issues/zJ.DEC-JAN09.pdf (p. 24, Linux on System z Kernel News) Mit freundlichem Gruß / Kind regards, Gerald Schäfer Linux on System z Development IBM Systems &Technology Group, Systems Software Development / SW Linux für zSeries Entwicklung --- IBM Deutschland Schoenaicher Str. 220 71032 Boeblingen Phone: +49-7031-16-2275 Fax: +49-7031-16-3456 E-Mail: geral...@de.ibm.com --- IBM Deutschland Research & Development GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 Linux on 390 Port wrote on 11/17/2009 02:41:52 PM: > From: > > Richard Gasiorowski > > To: > > LINUX-390@VM.MARIST.EDU > > Date: > > 11/17/2009 02:42 PM > > Subject: > > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > Gerald, > > Good stuff - has IBM published any studies or can you provide? > > > Richard (Gaz) Gasiorowski > Global System z Linux Virutalization and Mainframce Services Product > Manager Americas RPE Portfolio Platform Services CSC 3170 Fairview > Park Dr., Falls Church, VA 22042 > 845-889-8533|Work|845-392-7889 Cell|rgasi...@csc.com|www.csc.com > > > > > This is a PRIVATE message. If you are not the intended recipient, please > delete without copying and kindly advise us by e-mail of the mistake in > delivery. > NOTE: Regardless of content, this e-mail shall not operate to bind CSC to > any order or other contract unless pursuant to explicit written agreement > or government initiative expressly permitting the use of e-mail for such > purpose. > > > > From: > Gerald Schaefer > To: > LINUX-390@VM.MARIST.EDU > Date: > 11/17/2009 08:36 AM > Subject: > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > > > Hi, > > you should see a large benefit in page table memory consumption with > applications > that use lots of processes on shared (hugepage) memory mappings. IIRC, > Oracle > should also benefit from this. > > You will save 2 MB of page table memory per 1 GB of shared memory mapping, > > per > process. This will scale with the size of the memory mapping and the > number of > processes, up to the point that you can save more memory used for page > tables > than you were actually sharing between the processes. For example, with > 1000 > processes sharing 1 GB of (hugepage) memory, you will save 2 GB of memory > tha
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Hi, I have official answer from oracle that oracle database not available for zlinux :(. Jakub Szefler Administrator Mainframe Pion Operacji IT Grupy TP/Departament Infrastruktury Wydział Infrastruktury Informatycznej Dział Platform Serwerowych i Pamięci Masowych ul. Goplańska 25, 91-463 Łódź tel.0 42 655 32 29 fax.0 42 655 42 22 Telekomunikacja Polska <<http://www.tp.pl>> Telekomunikacja Polska Spółka Akcyjna z siedzibą i adresem w Warszawie (00-105) przy ulicy Twardej 18, wpisana do Rejestru Przedsiębiorców prowadzonego przez Sąd Rejonowy dla m.st.Warszawy XII Wydział Gospodarczy Krajowego Rejestru Sądowego pod numerem 010681; REGON 012100784, NIP 526-02-50-995; z pokrytym w całości kapitałem zakładowym wynoszącym 4 106 319 723 zł __ Treść tej wiadomości zawiera informacje przeznaczone tylko dla adresata. Jeżeli nie jesteście Państwo jej adresatem, bądź otrzymaliście ją przez pomyłkę, prosimy o powiadomienie o tym nadawcy oraz trwałe jej usunięcie. -Original Message- From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of Gerald Schaefer Sent: Tuesday, November 17, 2009 2:54 PM To: LINUX-390@VM.MARIST.EDU Subject: Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 Hi, I am not aware of any specific studies, but the page table sharing benefit was explained in some detail in a z/Journal article: http://zjournal.tcipubs.com/issues/zJ.DEC-JAN09.pdf (p. 24, Linux on System z Kernel News) Mit freundlichem Gruß / Kind regards, Gerald Schäfer Linux on System z Development IBM Systems &Technology Group, Systems Software Development / SW Linux für zSeries Entwicklung --- IBM Deutschland Schoenaicher Str. 220 71032 Boeblingen Phone: +49-7031-16-2275 Fax: +49-7031-16-3456 E-Mail: geral...@de.ibm.com --- IBM Deutschland Research & Development GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 Linux on 390 Port wrote on 11/17/2009 02:41:52 PM: > From: > > Richard Gasiorowski > > To: > > LINUX-390@VM.MARIST.EDU > > Date: > > 11/17/2009 02:42 PM > > Subject: > > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > Gerald, > > Good stuff - has IBM published any studies or can you provide? > > > Richard (Gaz) Gasiorowski > Global System z Linux Virutalization and Mainframce Services Product > Manager Americas RPE Portfolio Platform Services CSC 3170 Fairview > Park Dr., Falls Church, VA 22042 > 845-889-8533|Work|845-392-7889 Cell|rgasi...@csc.com|www.csc.com > > > > > This is a PRIVATE message. If you are not the intended recipient, please > delete without copying and kindly advise us by e-mail of the mistake in > delivery. > NOTE: Regardless of content, this e-mail shall not operate to bind CSC to > any order or other contract unless pursuant to explicit written agreement > or government initiative expressly permitting the use of e-mail for such > purpose. > > > > From: > Gerald Schaefer > To: > LINUX-390@VM.MARIST.EDU > Date: > 11/17/2009 08:36 AM > Subject: > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > > > Hi, > > you should see a large benefit in page table memory consumption with > applications > that use lots of processes on shared (hugepage) memory mappings. IIRC, > Oracle > should also benefit from this. > > You will save 2 MB of page table memory per 1 GB of shared memory mapping, > > per > process. This will scale with the size of the memory mapping and the > number of > processes, up to the point that you can save more memory used for page > tables > than you were actually sharing between the processes. For example, with > 1000 > processes sharing 1 GB of (hugepage) memory, you will save 2 GB of memory > that > would otherwise be used for page tables w/o hugepages. > > Mit freundlichem Gruß / Kind regards, > > Gerald Schäfer > > Linux on System z Development > IBM Systems &Technology Group, Systems Software Development / SW Linux für > > zSeries Entwicklung > --- > IBM Deutschland > Schoenaicher Str. 220 > 71032 Boeblingen > Phone: +49-7031-16-2275 > Fax: +49-7031-16-3456 > E-Mail: geral...@de.ibm.com > --- > IBM Deutschland Research & Development GmbH / Vorsitzender des >
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Hi, I am not aware of any specific studies, but the page table sharing benefit was explained in some detail in a z/Journal article: http://zjournal.tcipubs.com/issues/zJ.DEC-JAN09.pdf (p. 24, Linux on System z Kernel News) Mit freundlichem Gruß / Kind regards, Gerald Schäfer Linux on System z Development IBM Systems &Technology Group, Systems Software Development / SW Linux für zSeries Entwicklung --- IBM Deutschland Schoenaicher Str. 220 71032 Boeblingen Phone: +49-7031-16-2275 Fax: +49-7031-16-3456 E-Mail: geral...@de.ibm.com --- IBM Deutschland Research & Development GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 Linux on 390 Port wrote on 11/17/2009 02:41:52 PM: > From: > > Richard Gasiorowski > > To: > > LINUX-390@VM.MARIST.EDU > > Date: > > 11/17/2009 02:42 PM > > Subject: > > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > Gerald, > > Good stuff - has IBM published any studies or can you provide? > > > Richard (Gaz) Gasiorowski > Global System z Linux Virutalization and Mainframce Services Product > Manager > Americas RPE Portfolio Platform Services > CSC > 3170 Fairview Park Dr., Falls Church, VA 22042 > 845-889-8533|Work|845-392-7889 Cell|rgasi...@csc.com|www.csc.com > > > > > This is a PRIVATE message. If you are not the intended recipient, please > delete without copying and kindly advise us by e-mail of the mistake in > delivery. > NOTE: Regardless of content, this e-mail shall not operate to bind CSC to > any order or other contract unless pursuant to explicit written agreement > or government initiative expressly permitting the use of e-mail for such > purpose. > > > > From: > Gerald Schaefer > To: > LINUX-390@VM.MARIST.EDU > Date: > 11/17/2009 08:36 AM > Subject: > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > > > Hi, > > you should see a large benefit in page table memory consumption with > applications > that use lots of processes on shared (hugepage) memory mappings. IIRC, > Oracle > should also benefit from this. > > You will save 2 MB of page table memory per 1 GB of shared memory mapping, > > per > process. This will scale with the size of the memory mapping and the > number of > processes, up to the point that you can save more memory used for page > tables > than you were actually sharing between the processes. For example, with > 1000 > processes sharing 1 GB of (hugepage) memory, you will save 2 GB of memory > that > would otherwise be used for page tables w/o hugepages. > > Mit freundlichem Gruß / Kind regards, > > Gerald Schäfer > > Linux on System z Development > IBM Systems &Technology Group, Systems Software Development / SW Linux für > > zSeries Entwicklung > --- > IBM Deutschland > Schoenaicher Str. 220 > 71032 Boeblingen > Phone: +49-7031-16-2275 > Fax: +49-7031-16-3456 > E-Mail: geral...@de.ibm.com > --- > IBM Deutschland Research & Development GmbH / Vorsitzender des > Aufsichtsrats: Martin Jetter > Geschäftsführung: Dirk Wittkopp > Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, > > HRB 243294 > > > Linux on 390 Port wrote on 11/16/2009 06:20:51 > PM: > > > From: > > > > Richard Gasiorowski > > > > To: > > > > LINUX-390@VM.MARIST.EDU > > > > Date: > > > > 11/16/2009 06:21 PM > > > > Subject: > > > > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > > > Jakub, > > > > I do not see the benefit of hugepages and system z linux. My answer is > > simply does not apply. > > > > Richard (Gaz) Gasiorowski > > Global System z Linux Virutalization and Mainframce Services Product > > Manager > > Americas RPE Portfolio Platform Services > > CSC > > 3170 Fairview Park Dr., Falls Church, VA 22042 > > 845-889-8533|Work|845-392-7889 Cell|rgasi...@csc.com|www.csc.com > > > > > > > > > > This is a PRIVATE message. If you are not the intended recipient, please > > > > delete without copying and kindly advise us by e-mail of the mistake in > > d
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Gerald, Good stuff - has IBM published any studies or can you provide? Richard (Gaz) Gasiorowski Global System z Linux Virutalization and Mainframce Services Product Manager Americas RPE Portfolio Platform Services CSC 3170 Fairview Park Dr., Falls Church, VA 22042 845-889-8533|Work|845-392-7889 Cell|rgasi...@csc.com|www.csc.com This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind CSC to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose. From: Gerald Schaefer To: LINUX-390@VM.MARIST.EDU Date: 11/17/2009 08:36 AM Subject: Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 Hi, you should see a large benefit in page table memory consumption with applications that use lots of processes on shared (hugepage) memory mappings. IIRC, Oracle should also benefit from this. You will save 2 MB of page table memory per 1 GB of shared memory mapping, per process. This will scale with the size of the memory mapping and the number of processes, up to the point that you can save more memory used for page tables than you were actually sharing between the processes. For example, with 1000 processes sharing 1 GB of (hugepage) memory, you will save 2 GB of memory that would otherwise be used for page tables w/o hugepages. Mit freundlichem Gruß / Kind regards, Gerald Schäfer Linux on System z Development IBM Systems &Technology Group, Systems Software Development / SW Linux für zSeries Entwicklung --- IBM Deutschland Schoenaicher Str. 220 71032 Boeblingen Phone: +49-7031-16-2275 Fax: +49-7031-16-3456 E-Mail: geral...@de.ibm.com --- IBM Deutschland Research & Development GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 Linux on 390 Port wrote on 11/16/2009 06:20:51 PM: > From: > > Richard Gasiorowski > > To: > > LINUX-390@VM.MARIST.EDU > > Date: > > 11/16/2009 06:21 PM > > Subject: > > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > Jakub, > > I do not see the benefit of hugepages and system z linux. My answer is > simply does not apply. > > Richard (Gaz) Gasiorowski > Global System z Linux Virutalization and Mainframce Services Product > Manager > Americas RPE Portfolio Platform Services > CSC > 3170 Fairview Park Dr., Falls Church, VA 22042 > 845-889-8533|Work|845-392-7889 Cell|rgasi...@csc.com|www.csc.com > > > > > This is a PRIVATE message. If you are not the intended recipient, please > delete without copying and kindly advise us by e-mail of the mistake in > delivery. > NOTE: Regardless of content, this e-mail shall not operate to bind CSC to > any order or other contract unless pursuant to explicit written agreement > or government initiative expressly permitting the use of e-mail for such > purpose. > > > > From: > Joe Comitini > To: > LINUX-390@VM.MARIST.EDU > Date: > 11/16/2009 11:15 AM > Subject: > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > > > We're looking into it but I think the official word is that it's not > supported by Oracle ... Please check with your Oracle rep > > Joe > > -Original Message- > From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of > Szefler Jakub > Sent: Friday, November 06, 2009 6:08 AM > To: LINUX-390@VM.MARIST.EDU > Subject: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > Hi, > Did someone configure oracle and hugepages under SLES10SP2 and it works ? > > > Jakub Szefler > Administrator Mainframe > > Pion Operacji IT Grupy TP/Departament Infrastruktury Wydział > Infrastruktury Informatycznej Dział Platform Serwerowych i Pamięci > Masowych > > > -- > For LINUX-390 subscribe / signoff / archive access instructions, send > email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit > http://www.marist.edu/htbin/wlvindex?LINUX-390 > > -- > For LINUX-390 subscribe / signoff / archive access instructions, > send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or > visit > http://www.marist.edu/htbin/wlvindex?LINUX-390 &
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Hi, you should see a large benefit in page table memory consumption with applications that use lots of processes on shared (hugepage) memory mappings. IIRC, Oracle should also benefit from this. You will save 2 MB of page table memory per 1 GB of shared memory mapping, per process. This will scale with the size of the memory mapping and the number of processes, up to the point that you can save more memory used for page tables than you were actually sharing between the processes. For example, with 1000 processes sharing 1 GB of (hugepage) memory, you will save 2 GB of memory that would otherwise be used for page tables w/o hugepages. Mit freundlichem Gruß / Kind regards, Gerald Schäfer Linux on System z Development IBM Systems &Technology Group, Systems Software Development / SW Linux für zSeries Entwicklung --- IBM Deutschland Schoenaicher Str. 220 71032 Boeblingen Phone: +49-7031-16-2275 Fax: +49-7031-16-3456 E-Mail: geral...@de.ibm.com --- IBM Deutschland Research & Development GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 Linux on 390 Port wrote on 11/16/2009 06:20:51 PM: > From: > > Richard Gasiorowski > > To: > > LINUX-390@VM.MARIST.EDU > > Date: > > 11/16/2009 06:21 PM > > Subject: > > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > Jakub, > > I do not see the benefit of hugepages and system z linux. My answer is > simply does not apply. > > Richard (Gaz) Gasiorowski > Global System z Linux Virutalization and Mainframce Services Product > Manager > Americas RPE Portfolio Platform Services > CSC > 3170 Fairview Park Dr., Falls Church, VA 22042 > 845-889-8533|Work|845-392-7889 Cell|rgasi...@csc.com|www.csc.com > > > > > This is a PRIVATE message. If you are not the intended recipient, please > delete without copying and kindly advise us by e-mail of the mistake in > delivery. > NOTE: Regardless of content, this e-mail shall not operate to bind CSC to > any order or other contract unless pursuant to explicit written agreement > or government initiative expressly permitting the use of e-mail for such > purpose. > > > > From: > Joe Comitini > To: > LINUX-390@VM.MARIST.EDU > Date: > 11/16/2009 11:15 AM > Subject: > Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > > > We're looking into it but I think the official word is that it's not > supported by Oracle ... Please check with your Oracle rep > > Joe > > -Original Message- > From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of > Szefler Jakub > Sent: Friday, November 06, 2009 6:08 AM > To: LINUX-390@VM.MARIST.EDU > Subject: Hugepages+oracle 10.0.2.0.4 in sles10SP2 > > Hi, > Did someone configure oracle and hugepages under SLES10SP2 and it works ? > > > Jakub Szefler > Administrator Mainframe > > Pion Operacji IT Grupy TP/Departament Infrastruktury Wydział > Infrastruktury Informatycznej Dział Platform Serwerowych i Pamięci > Masowych > > > -- > For LINUX-390 subscribe / signoff / archive access instructions, send > email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit > http://www.marist.edu/htbin/wlvindex?LINUX-390 > > -- > For LINUX-390 subscribe / signoff / archive access instructions, > send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or > visit > http://www.marist.edu/htbin/wlvindex?LINUX-390 > > > > -- > For LINUX-390 subscribe / signoff / archive access instructions, > send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit > http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
Jakub, I do not see the benefit of hugepages and system z linux. My answer is simply does not apply. Richard (Gaz) Gasiorowski Global System z Linux Virutalization and Mainframce Services Product Manager Americas RPE Portfolio Platform Services CSC 3170 Fairview Park Dr., Falls Church, VA 22042 845-889-8533|Work|845-392-7889 Cell|rgasi...@csc.com|www.csc.com This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind CSC to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose. From: Joe Comitini To: LINUX-390@VM.MARIST.EDU Date: 11/16/2009 11:15 AM Subject: Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2 We're looking into it but I think the official word is that it's not supported by Oracle ... Please check with your Oracle rep Joe -Original Message- From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of Szefler Jakub Sent: Friday, November 06, 2009 6:08 AM To: LINUX-390@VM.MARIST.EDU Subject: Hugepages+oracle 10.0.2.0.4 in sles10SP2 Hi, Did someone configure oracle and hugepages under SLES10SP2 and it works ? Jakub Szefler Administrator Mainframe Pion Operacji IT Grupy TP/Departament Infrastruktury Wydział Infrastruktury Informatycznej Dział Platform Serwerowych i Pamięci Masowych -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
Re: Hugepages+oracle 10.0.2.0.4 in sles10SP2
We're looking into it but I think the official word is that it's not supported by Oracle ... Please check with your Oracle rep Joe -Original Message- From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of Szefler Jakub Sent: Friday, November 06, 2009 6:08 AM To: LINUX-390@VM.MARIST.EDU Subject: Hugepages+oracle 10.0.2.0.4 in sles10SP2 Hi, Did someone configure oracle and hugepages under SLES10SP2 and it works ? Jakub Szefler Administrator Mainframe Pion Operacji IT Grupy TP/Departament Infrastruktury Wydział Infrastruktury Informatycznej Dział Platform Serwerowych i Pamięci Masowych -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
