> > > Please recommend a module that allows persistent set/dict storage + > > > fast query that best fits my problem, > > > > What is the problem you are trying to solve? How many keys do you have? > > Corpus processing. There are in the order of billions to tens of > billions keys (64bit integers). > I would recommend you to use a database since it meets your requirements (off-memory, fast, persistent). The bsdddb module (berkeley db) even gives you a dictionary like interface. http://www.python.org/doc/lib/module-bsddb.html
regards, Rafa -- http://mail.python.org/mailman/listinfo/python-list