> -----Original Message----- > From: Quanah Gibson-Mount [mailto:[email protected]] > Sent: Tuesday, April 05, 2011 12:50 PM > To: Cannady, Mike; Christian Kratzer > Cc: [email protected] > Subject: RE: Speeding up BDB question > > > > --On April 5, 2011 7:58:19 AM -0400 "Cannady, Mike" > <[email protected]> wrote: > > > > I agree. I saw no hint of using sysv shared memory anywhere in the > > openldap FAQ. I assume that "DB_SYSTEM_MEM" would have to be in the > > DB_CONFIG file and "dbconfig set_flags DB_SYSTEM_MEM" in slapd.conf to > > cover a new database. Is this correct? > > I'm talking about shared memory keys, which is documented in the > slapd-bdb(5) and slapd-hdb(5) manual pages.
I was looking at the BDB documentation and missed it in slapd-bdb. I reconfigured both masters to use shm_key, removed dncachesize and ran ldapadd. It took only 50 minutes to load 51,265 DNs. That is a better than the 6-8 hours before. There still seemed to be a lot of small cpu usage and a lot of I/O waiting. > > > I used the ram filesystem to see if there was a lot of filesystem > > flushing via some kind of sync. The I/Os I saw just didn't seem right > > for the amount of changes happening every minute. > > > > As to the database size and such: The ldapadd was adding 51,265 DNs > > back into the ldap store. The preceding delete was close to that number > > also. The database before any of the operations had 71,886 DNs > > Then it is clear your cachesize and idlcachesize settings are all too > small. I would also note you should never, *EVER*, set the dncachesize > unless you are on a terribly memory restricted machine. You should always > leave it at the default of infinite. > > You still fail to note the size of the BDB database (du -c -h *.bdb) so > again it is impossible to say if your DB_CONFIG settings are correct. > Sorry about missing the size of the database... Here it is ( 71,914 DNs ): [root@LDAPdev1 openldap-data]# du -c -h *.bdb 35M cn.bdb 16M dn2id.bdb 3.5M entryCSN.bdb 2.2M entryUUID.bdb 18M givenName.bdb 96M id2entry.bdb 3.2M objectClass.bdb 9.0K ou.bdb 21M sn.bdb 20M uid.bdb 2.0M uniqueIdentifier.bdb 214M total > --Quanah > > > -- > Quanah Gibson-Mount > Principal Software Engineer > Zimbra, Inc > -------------------- > Zimbra :: the leader in open source messaging and collaboration I'll bump up the cachesize to 100,000 and idlcachesize to 300,000 and rerun my tests. ---Thanks for the help! ---Mike Cannady ********************************************************************** HTC Disclaimer: The information contained in this message may be privileged and confidential and protected from disclosure. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer. Thank you. **********************************************************************
