Hi Alexander,
Actually the same error appears both during indexing and searching.
Let me describe the indexing error first.
After processing 100.000 of about 115.000 records I get the following
error:
Fatal error: Allowed memory size of 20971520 bytes exhausted (tried
to allocate 42 bytes) in ZendFramework/Zend/Search/Lucene/Storage/
File/Filesystem.php on line 147
When I look at the index files I get about 10 3 MB files and one
14.3MB file. Looking at both time and size, my guess is that this is
the part where it all went wrong.
The records in the database are no more than 10kb each, so it's weird
that such a big file is being created imho...
A similar error occurs when trying to seach for a single letter in
the big index (only at line 154).
Any help would be greatly appreciated. In the mean time I will try to
find out more about where exactly it freezes. It might give a clue on
how to solve the problem.
On 15 Apr 2007, at 21:43, Alexander Veremyev wrote:
Hi Jurriën,
Please describe when problem appears. Does this happen during the
indexing or during index opening?
What is the value of MaxBufferedDocs option? (http://
framework.zend.com/manual/en/zend.search.index-
creation.html#zend.search.index-creation.optimization)
With best regards,
Alexander Veremyev.
Jurriën Stutterheim wrote:
Hi all,
While indexing a large database (> 100.000 records) I reached the
memory limit for that shared host. The problem appears in
Zend_Search_Lucene_Storage_File_Filesystem line 158 when the index
file hits the 10MB.
Is it possible to specify the max size for the index files? Or is
it possible to use Zend_Memory as a solution?
Thanks
