Re: Inserting large values into memcached
The keys being set look like: sprintf(key, "bob:%d", keyMin); ie: "bob:1" the keys being fetched look like: sprintf(key, "%d", keyMin); ie: "1". not sure how this is supposed to work? On Mon, 18 Jul 2016, Sonia wrote: > > To execute the program, you will need a txt file containing a list of all the > servers. You can make changes to this file accordingly. > If you execute the code with a -h option you will get details of the command > line args. > > On Thursday, July 14, 2016 at 2:29:06 PM UTC-5, Dormando wrote: > Hey, > > In order to understand I'd have to see the details firsthand at this > point: Output of `stats` and `stats settings` commands, as well as any > example code you can share. > > On Thu, 14 Jul 2016, Sonia wrote: > > > Everything seems in order, but cant seem to find a reason for this > odd behaviour. > > > > On Wednesday, July 13, 2016 at 11:22:07 PM UTC-5, Dormando wrote: > > I'm not sure why. you can validate the settings via the `stats > settings` > > command. > > > > On Wed, 13 Jul 2016, Sonia wrote: > > > > > I tried inserting 10 values of size 100 bytes. I am able > to insert all 10 values but I guess only the last 3 are present in cache > since I am getting > cache > > misses for the > > > first 7 key-value pairs.Is there a flag that we have to set > in the memcached configuration file (I currently have the '-m' option set to > 2048) > > > > > > On Wednesday, July 13, 2016 at 7:07:44 PM UTC-5, Dormando > wrote: > > > Hi, > > > > > > You're trying to store exactly 1024*1024 bytes, but an > value in memcached > > > encompasses the key and the datastructure behind it. > Try (1024*1024 - > > > 4096) and see if that stores. > > > > > > On Wed, 13 Jul 2016, Sonia wrote: > > > > > > > For 100,000 1MB values I guess the memory I have > allocated is insufficient. However, I tried inserting 10 1MB values into > memcached but this too > fails > > and > > > memcached_strerror() > > > > returns "ITEM TOO BIG" (The value I have is a random > alpha-numeric char array of size 1048756 bytes).I am currently using a > libmemcached client. > Also > > please find > > > the output of > > > > the stats command in the attached file. > > > > I really appreciate the help. Thank you. > > > > > > > > On Wednesday, July 13, 2016 at 2:39:43 PM UTC-5, > Dormando wrote: > > > > Can you give more detail as to what exactly is > failing? what error message > > > > are you getting, what client are you using, > what is the `stats` output > > > > from some of your memcached instances, etc? > > > > > > > > 100,000 1 meg values are going to take at least > 100 gigabytes of RAM. if > > > > you have 16 2G servers, you only have 32G of > RAM available. I can't really > > > > help until knowing what your real error message > is but that math seems a > > > > little odd. > > > > > > > > On Wed, 13 Jul 2016, Sonia wrote: > > > > > > > > > I have just started working with memcached > and I am working on a test program where I want to insert 100,000 values of > size 1 MB into > memcached.I > > > currently have > > > > 16 servers > > > > > setup and I have setup the memory limit in > the memcached configuration file as 2 GB but for some reason my code is still > failing. > > > > > Has anybody faced a similar situation? > > > > > > > > > > -- > > > > > > > > > > --- > > > > > You received this message because you are > subscribed to the Google Groups "memcached" group. > > > > > To unsubscribe from this group and stop > receiving emails from it, send an email to memcached+...@googlegroups.com. > > > > > For more options, visit > https://groups.google.com/d/optout. > > > > > > > > > > > > > > > > > > -- > > > > > > > > --- > > > > You received this message because you are subscribed > to the Google Groups "memcached" group. > > > > To unsubscribe from this
Re: Inserting large values into memcached
To execute the program, you will need a txt file containing a list of all the servers. You can make changes to this file accordingly. If you execute the code with a -h option you will get details of the command line args. On Thursday, July 14, 2016 at 2:29:06 PM UTC-5, Dormando wrote: > > Hey, > > In order to understand I'd have to see the details firsthand at this > point: Output of `stats` and `stats settings` commands, as well as any > example code you can share. > > On Thu, 14 Jul 2016, Sonia wrote: > > > Everything seems in order, but cant seem to find a reason for this odd > behaviour. > > > > On Wednesday, July 13, 2016 at 11:22:07 PM UTC-5, Dormando wrote: > > I'm not sure why. you can validate the settings via the `stats > settings` > > command. > > > > On Wed, 13 Jul 2016, Sonia wrote: > > > > > I tried inserting 10 values of size 100 bytes. I am able to > insert all 10 values but I guess only the last 3 are present in cache since > I am getting cache > > misses for the > > > first 7 key-value pairs.Is there a flag that we have to set in > the memcached configuration file (I currently have the '-m' option set to > 2048) > > > > > > On Wednesday, July 13, 2016 at 7:07:44 PM UTC-5, Dormando wrote: > > > Hi, > > > > > > You're trying to store exactly 1024*1024 bytes, but an > value in memcached > > > encompasses the key and the datastructure behind it. Try > (1024*1024 - > > > 4096) and see if that stores. > > > > > > On Wed, 13 Jul 2016, Sonia wrote: > > > > > > > For 100,000 1MB values I guess the memory I have > allocated is insufficient. However, I tried inserting 10 1MB values into > memcached but this too fails > > and > > > memcached_strerror() > > > > returns "ITEM TOO BIG" (The value I have is a random > alpha-numeric char array of size 1048756 bytes).I am currently using a > libmemcached client. Also > > please find > > > the output of > > > > the stats command in the attached file. > > > > I really appreciate the help. Thank you. > > > > > > > > On Wednesday, July 13, 2016 at 2:39:43 PM UTC-5, > Dormando wrote: > > > > Can you give more detail as to what exactly is > failing? what error message > > > > are you getting, what client are you using, what > is the `stats` output > > > > from some of your memcached instances, etc? > > > > > > > > 100,000 1 meg values are going to take at least > 100 gigabytes of RAM. if > > > > you have 16 2G servers, you only have 32G of RAM > available. I can't really > > > > help until knowing what your real error message is > but that math seems a > > > > little odd. > > > > > > > > On Wed, 13 Jul 2016, Sonia wrote: > > > > > > > > > I have just started working with memcached and I > am working on a test program where I want to insert 100,000 values of size > 1 MB into memcached.I > > > currently have > > > > 16 servers > > > > > setup and I have setup the memory limit in the > memcached configuration file as 2 GB but for some reason my code is still > failing. > > > > > Has anybody faced a similar situation? > > > > > > > > > > -- > > > > > > > > > > --- > > > > > You received this message because you are > subscribed to the Google Groups "memcached" group. > > > > > To unsubscribe from this group and stop > receiving emails from it, send an email to memcached+...@googlegroups.com. > > > > > > For more options, visit > https://groups.google.com/d/optout. > > > > > > > > > > > > > > > > > > -- > > > > > > > > --- > > > > You received this message because you are subscribed to > the Google Groups "memcached" group. > > > > To unsubscribe from this group and stop receiving emails > from it, send an email to memcached+...@googlegroups.com. > > > > For more options, visit > https://groups.google.com/d/optout. > > > > > > > > > > > > > > -- > > > > > > --- > > > You received this message because you are subscribed to the > Google Groups "memcached" group. > > > To unsubscribe from this group and stop receiving emails from > it, send an email to memcached+...@googlegroups.com. > > > For more options, visit https://groups.google.com/d/optout. > > >
Re: Inserting large values into memcached
Hello, I am attaching the source code for the sample MPI code that I wrote. On Thursday, July 14, 2016 at 2:29:06 PM UTC-5, Dormando wrote: > > Hey, > > In order to understand I'd have to see the details firsthand at this > point: Output of `stats` and `stats settings` commands, as well as any > example code you can share. > > On Thu, 14 Jul 2016, Sonia wrote: > > > Everything seems in order, but cant seem to find a reason for this odd > behaviour. > > > > On Wednesday, July 13, 2016 at 11:22:07 PM UTC-5, Dormando wrote: > > I'm not sure why. you can validate the settings via the `stats > settings` > > command. > > > > On Wed, 13 Jul 2016, Sonia wrote: > > > > > I tried inserting 10 values of size 100 bytes. I am able to > insert all 10 values but I guess only the last 3 are present in cache since > I am getting cache > > misses for the > > > first 7 key-value pairs.Is there a flag that we have to set in > the memcached configuration file (I currently have the '-m' option set to > 2048) > > > > > > On Wednesday, July 13, 2016 at 7:07:44 PM UTC-5, Dormando wrote: > > > Hi, > > > > > > You're trying to store exactly 1024*1024 bytes, but an > value in memcached > > > encompasses the key and the datastructure behind it. Try > (1024*1024 - > > > 4096) and see if that stores. > > > > > > On Wed, 13 Jul 2016, Sonia wrote: > > > > > > > For 100,000 1MB values I guess the memory I have > allocated is insufficient. However, I tried inserting 10 1MB values into > memcached but this too fails > > and > > > memcached_strerror() > > > > returns "ITEM TOO BIG" (The value I have is a random > alpha-numeric char array of size 1048756 bytes).I am currently using a > libmemcached client. Also > > please find > > > the output of > > > > the stats command in the attached file. > > > > I really appreciate the help. Thank you. > > > > > > > > On Wednesday, July 13, 2016 at 2:39:43 PM UTC-5, > Dormando wrote: > > > > Can you give more detail as to what exactly is > failing? what error message > > > > are you getting, what client are you using, what > is the `stats` output > > > > from some of your memcached instances, etc? > > > > > > > > 100,000 1 meg values are going to take at least > 100 gigabytes of RAM. if > > > > you have 16 2G servers, you only have 32G of RAM > available. I can't really > > > > help until knowing what your real error message is > but that math seems a > > > > little odd. > > > > > > > > On Wed, 13 Jul 2016, Sonia wrote: > > > > > > > > > I have just started working with memcached and I > am working on a test program where I want to insert 100,000 values of size > 1 MB into memcached.I > > > currently have > > > > 16 servers > > > > > setup and I have setup the memory limit in the > memcached configuration file as 2 GB but for some reason my code is still > failing. > > > > > Has anybody faced a similar situation? > > > > > > > > > > -- > > > > > > > > > > --- > > > > > You received this message because you are > subscribed to the Google Groups "memcached" group. > > > > > To unsubscribe from this group and stop > receiving emails from it, send an email to memcached+...@googlegroups.com. > > > > > > For more options, visit > https://groups.google.com/d/optout. > > > > > > > > > > > > > > > > > > -- > > > > > > > > --- > > > > You received this message because you are subscribed to > the Google Groups "memcached" group. > > > > To unsubscribe from this group and stop receiving emails > from it, send an email to memcached+...@googlegroups.com. > > > > For more options, visit > https://groups.google.com/d/optout. > > > > > > > > > > > > > > -- > > > > > > --- > > > You received this message because you are subscribed to the > Google Groups "memcached" group. > > > To unsubscribe from this group and stop receiving emails from > it, send an email to memcached+...@googlegroups.com. > > > For more options, visit https://groups.google.com/d/optout. > > > > > > > > > > -- > > > > --- > > You received this message because you are subscribed to the Google > Groups "memcached" group. > > To
