Re: ZODB for inverted index?

2006-10-25 Thread robert
[EMAIL PROTECTED] wrote: > Hello, > > While playing to write an inverted index (see: > http://en.wikipedia.org/wiki/Inverted_index), i run out of memory with > a classic dict, (i have thousand of documents and millions of terms, > stemming or other filtering are not considered, i wanted to underst

Re: ZODB for inverted index?

2006-10-25 Thread Klaas
[EMAIL PROTECTED] wrote: > Hello, Hi. I'm not familiar with ZODB, but you might consider berkeleydb, which behaves like a disk-backed + memcache dictionary. -Mike -- http://mail.python.org/mailman/listinfo/python-list

Re: ZODB for inverted index?

2006-10-25 Thread Gabriel Genellina
At Wednesday 25/10/2006 03:54, [EMAIL PROTECTED] wrote: anyway can someone help me on how to "rewrite" and "reload" a class instance when using ZODB ? What do you mean? -- Gabriel Genellina Softlab SRL __ Correo Yahoo! Espacio para todos tus

Re: ZODB for inverted index?

2006-10-24 Thread vd12005
thanks for your reply, anyway can someone help me on how to "rewrite" and "reload" a class instance when using ZODB ? regards -- http://mail.python.org/mailman/listinfo/python-list

Re: ZODB for inverted index?

2006-10-23 Thread Bates bateswebsafe
You may want to take a quick look at ZCatalogs. They are for indexing ZODB objects. I may not be understanding what you are trying to do. I suspect that you really need to store everything in a database (MySQL/Postgres/etc) for maximal flexibility. -Larry -- http://mail.python.org/mailman/list

ZODB for inverted index?

2006-10-23 Thread vd12005
Hello, While playing to write an inverted index (see: http://en.wikipedia.org/wiki/Inverted_index), i run out of memory with a classic dict, (i have thousand of documents and millions of terms, stemming or other filtering are not considered, i wanted to understand how to handle GB of text first).