Large Page Support in Linux
Has anyone ever gotten the '-L' (large page support) to work in Linux? I know my amazon 2017.03 AMI kernel supports huge-pages. In theory, I have set up my box 512 huge pages at 2MB each so I can start memcached with a 1GB cache size. I've verified this by doing `cat /proc/meminfo |grep Huge`, which yields: AnonHugePages:243712 kB ShmemHugePages:0 kB HugePages_Total: 512 HugePages_Free: 512 HugePages_Rsvd:0 HugePages_Surp:0 Hugepagesize: 2048 kB I saw that as of 1.42, there was some support for libhugetlbfs...but there really isnt much info around how to make that lib work with memcached. In digging around the internet...there doesn't seem to be a whole lot in terms of success stories around people getting this feature to work. Does anyone here have any more info that might be useful? thanks, /m -- --- You received this message because you are subscribed to the Google Groups "memcached" group. To unsubscribe from this group and stop receiving emails from it, send an email to memcached+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Large Page Support in Linux
It never actually worked in linux... support was written for solaris and I've never prioritized doing it in linux. You should open an issue on the github repo so people can register interest there; it shouldn't be too hard to do once some other stuff has settled down. On Mon, 3 Jul 2017, 'Mario Niebla' via memcached wrote: > Has anyone ever gotten the '-L' (large page support) to work in Linux? > > I know my amazon 2017.03 AMI kernel supports huge-pages. > > In theory, I have set up my box 512 huge pages at 2MB each so I can start > memcached with a 1GB cache size. > > I've verified this by doing `cat /proc/meminfo |grep Huge`, which yields: > > AnonHugePages: 243712 kB > ShmemHugePages: 0 kB > HugePages_Total: 512 > HugePages_Free: 512 > HugePages_Rsvd: 0 > HugePages_Surp: 0 > Hugepagesize: 2048 kB > > I saw that as of 1.42, there was some support for libhugetlbfs...but there > really isnt much info around how to make that lib work with memcached. > > In digging around the internet...there doesn't seem to be a whole lot in > terms of success stories around people getting this feature to work. > > Does anyone here have any more info that might be useful? > > thanks, > /m > > -- > > --- > You received this message because you are subscribed to the Google Groups > "memcached" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to memcached+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > > -- --- You received this message because you are subscribed to the Google Groups "memcached" group. To unsubscribe from this group and stop receiving emails from it, send an email to memcached+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Large Page Support in Linux
Ah, ok...thanks for the info. I'll do that. cheers, /m On Monday, July 3, 2017 at 12:34:42 PM UTC-7, Dormando wrote: > > It never actually worked in linux... support was written for solaris and > I've never prioritized doing it in linux. > > You should open an issue on the github repo so people can register > interest there; it shouldn't be too hard to do once some other stuff has > settled down. > > On Mon, 3 Jul 2017, 'Mario Niebla' via memcached wrote: > > > Has anyone ever gotten the '-L' (large page support) to work in Linux? > > > > I know my amazon 2017.03 AMI kernel supports huge-pages. > > > > In theory, I have set up my box 512 huge pages at 2MB each so I can > start memcached with a 1GB cache size. > > > > I've verified this by doing `cat /proc/meminfo |grep Huge`, which > yields: > > > > AnonHugePages:243712 kB > > ShmemHugePages:0 kB > > HugePages_Total: 512 > > HugePages_Free: 512 > > HugePages_Rsvd:0 > > HugePages_Surp:0 > > Hugepagesize: 2048 kB > > > > I saw that as of 1.42, there was some support for libhugetlbfs...but > there really isnt much info around how to make that lib work with > memcached. > > > > In digging around the internet...there doesn't seem to be a whole lot in > terms of success stories around people getting this feature to work. > > > > Does anyone here have any more info that might be useful? > > > > thanks, > > /m > > > > -- > > > > --- > > You received this message because you are subscribed to the Google > Groups "memcached" group. > > To unsubscribe from this group and stop receiving emails from it, send > an email to memcached+...@googlegroups.com . > > For more options, visit https://groups.google.com/d/optout. > > > > -- --- You received this message because you are subscribed to the Google Groups "memcached" group. To unsubscribe from this group and stop receiving emails from it, send an email to memcached+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Large Page Support in Linux
Out of curiosity; were you running into performance problems or just wanting to get it working? I've found that huge pages have some payoff but I kept getting better improvements by fixing other things :) On Mon, 3 Jul 2017, 'Mario Niebla' via memcached wrote: > Ah, ok...thanks for the info. I'll do that. > > cheers, > > /m > > On Monday, July 3, 2017 at 12:34:42 PM UTC-7, Dormando wrote: > It never actually worked in linux... support was written for solaris and > I've never prioritized doing it in linux. > > You should open an issue on the github repo so people can register > interest there; it shouldn't be too hard to do once some other stuff has > settled down. > > On Mon, 3 Jul 2017, 'Mario Niebla' via memcached wrote: > > > Has anyone ever gotten the '-L' (large page support) to work in > Linux? > > > > I know my amazon 2017.03 AMI kernel supports huge-pages. > > > > In theory, I have set up my box 512 huge pages at 2MB each so I can > start > memcached with a 1GB cache size. > > > > I've verified this by doing `cat /proc/meminfo |grep Huge`, which > yields: > > > > AnonHugePages: 243712 kB > > ShmemHugePages: 0 kB > > HugePages_Total: 512 > > HugePages_Free: 512 > > HugePages_Rsvd: 0 > > HugePages_Surp: 0 > > Hugepagesize: 2048 kB > > > > I saw that as of 1.42, there was some support for libhugetlbfs...but > there really isnt much info around how to make that lib work with > memcached. > > > > In digging around the internet...there doesn't seem to be a whole lot > in > terms of success stories around people getting this feature to work. > > > > Does anyone here have any more info that might be useful? > > > > thanks, > > /m > > > > -- > > > > --- > > You received this message because you are subscribed to the Google > Groups > "memcached" group. > > To unsubscribe from this group and stop receiving emails from it, > send an > email to memcached+...@googlegroups.com. > > For more options, visit https://groups.google.com/d/optout. > > > > > > -- > > --- > You received this message because you are subscribed to the Google Groups > "memcached" > group. > To unsubscribe from this group and stop receiving emails from it, send an > email to > memcached+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > > -- --- You received this message because you are subscribed to the Google Groups "memcached" group. To unsubscribe from this group and stop receiving emails from it, send an email to memcached+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.