Hi Stephen, Thanks for sharing this! VERY few people have experience with this stuff...
On 4/17/08, Stephen Reed <[EMAIL PROTECTED]> wrote: > 4. I began writing my own storage engine, for a fast, space-efficient, > partitioned and sharded knowledge base, soon realizing that this was far too > big a task for a sole developer. That seems like what we actually need. > My development Linux computer has 4 GB of memory, and Linux has a feature > called tmpfs which permits mounting a directory in RAM. I partitioned my KB > into separate KBs of less than six million rows each. In Sesame these are > less than one GB in size and I can therefore put any one of them in tmpfs - > running that application-relevant part of the KB at RAM speed. Experiments > demonstrate about a 10 times speedup. If the inference requires a rule outside the sub-KB, you'd have to do a very expensive swap. I think this only works if you're sure the entire inference is contained within a sub-KB. YKY ------------------------------------------- agi Archives: http://www.listbox.com/member/archive/303/=now RSS Feed: http://www.listbox.com/member/archive/rss/303/ Modify Your Subscription: http://www.listbox.com/member/?member_id=8660244&id_secret=101455710-f059c4 Powered by Listbox: http://www.listbox.com
