[ https://issues.apache.org/jira/browse/CASSANDRA-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13222039#comment-13222039 ]
Vijay edited comment on CASSANDRA-3997 at 3/4/12 10:30 PM: ----------------------------------------------------------- Attached is the test classes used for the test. Results on CentOS: {noformat} [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.MallocAllocator 50000 2000000 total used free shared buffers cached Mem: 71688220 26049380 45638840 0 169116 996172 -/+ buffers/cache: 24884092 46804128 Swap: 0 0 0 **** Starting Test! **** Total bytes read: 101422934016 Time taken: 25407 total used free shared buffers cached Mem: 71688220 31981924 39706296 0 169116 996312 -/+ buffers/cache: 30816496 40871724 Swap: 0 0 0 **** ending Test!**** [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export LD_LIBRARY_PATH=/usr/local/lib/ [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.TCMallocAllocator 50000 2000000 total used free shared buffers cached Mem: 71688220 26054620 45633600 0 169128 996228 -/+ buffers/cache: 24889264 46798956 Swap: 0 0 0 **** Starting Test! **** Total bytes read: 101304894464 Time taken: 46387 total used free shared buffers cached Mem: 71688220 28535136 43153084 0 169128 996436 -/+ buffers/cache: 27369572 44318648 Swap: 0 0 0 **** ending Test!**** [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export LD_LIBRARY_PATH=~/jemalloc-2.2.5/lib/ [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=~/jemalloc-2.2.5/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.JEMallocAllocator 50000 2000000 total used free shared buffers cached Mem: 71688220 26060604 45627616 0 169128 996300 -/+ buffers/cache: 24895176 46793044 Swap: 0 0 0 **** Starting Test! **** Total bytes read: 101321734144 Time taken: 29937 total used free shared buffers cached Mem: 71688220 28472436 43215784 0 169128 996440 -/+ buffers/cache: 27306868 44381352 Swap: 0 0 0 **** ending Test!**** [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ {noformat} The test shows around 4 GB savings. The test was on 101321734144 bytes (101 GB each). The test use CLHM to hold on to the objects and release them when the capacity is reached (5K) was (Author: vijay2...@yahoo.com): Attached is the test classes used for the test. Results on CentOS: {noformat} [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.MallocAllocator 50000 2000000 total used free shared buffers cached Mem: 71688220 26049380 45638840 0 169116 996172 -/+ buffers/cache: 24884092 46804128 Swap: 0 0 0 **** Starting Test! **** Total bytes read: 101422934016 Time taken: 25407 total used free shared buffers cached Mem: 71688220 31981924 39706296 0 169116 996312 -/+ buffers/cache: 30816496 40871724 Swap: 0 0 0 **** ending Test!**** [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export LD_LIBRARY_PATH=/usr/local/lib/ [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.TCMallocAllocator 50000 2000000 total used free shared buffers cached Mem: 71688220 26054620 45633600 0 169128 996228 -/+ buffers/cache: 24889264 46798956 Swap: 0 0 0 **** Starting Test! **** Total bytes read: 101304894464 Time taken: 46387 total used free shared buffers cached Mem: 71688220 28535136 43153084 0 169128 996436 -/+ buffers/cache: 27369572 44318648 Swap: 0 0 0 **** ending Test!**** [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export LD_LIBRARY_PATH=~/jemalloc-2.2.5/lib/ [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=~/jemalloc-2.2.5/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.JEMallocAllocator 50000 2000000 total used free shared buffers cached Mem: 71688220 26060604 45627616 0 169128 996300 -/+ buffers/cache: 24895176 46793044 Swap: 0 0 0 **** Starting Test! **** Total bytes read: 101321734144 Time taken: 29937 total used free shared buffers cached Mem: 71688220 28472436 43215784 0 169128 996440 -/+ buffers/cache: 27306868 44381352 Swap: 0 0 0 **** ending Test!**** [vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ {noformat} > Make SerializingCache Memory Pluggable > -------------------------------------- > > Key: CASSANDRA-3997 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3997 > Project: Cassandra > Issue Type: Improvement > Components: Core > Affects Versions: 1.2 > Reporter: Vijay > Priority: Minor > Labels: cache > Fix For: 1.2 > > Attachments: jna.zip > > > Serializing cache uses native malloc and free by making FM pluggable, users > will have a choice of gcc malloc, TCMalloc or JEMalloc as needed. > Initial tests shows less fragmentation in JEMalloc but the only issue with it > is that (both TCMalloc and JEMalloc) are kind of single threaded (at-least > they crash in my test otherwise). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira