Christian Heimes wrote: > Gabriel Genellina schrieb: > >> Apart from what everyone has already said, consider that FreqDist may import >> other modules, store global state, create other objects... whatever. >> Pure python code should not have any memory leaks (if there are, it's a bug >> in the Python interpreter). Not-carefully-written C extensions may introduce >> memory problems. >> > > Pure Python code can cause memory leaks. No, that's not a bug in the > interpreter but the fault of the developer. For example code that messes > around with stack frames and exception object can cause nasty reference > leaks. > > Christian > > In order to deal with 400 thousands texts consisting of 80 million words, and huge sets of corpora , I have to be care about the memory things. I need to track every word's behavior, so there needs to be as many word-objects as words. I am really suffering from the memory problem, even 4G memory space can not survive... Only 10,000 texts can kill it in 2 minutes. By the way, my program has been optimized to ``del`` the objects after traversing, in order not to store the information in memory all the time.
-- http://mail.python.org/mailman/listinfo/python-list